Sep 28 15:53:03 devstack cinder-volume[75518]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 15:53:03 devstack cinder-volume[75518]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 15:53:03 devstack cinder-volume[75518]: we strongly recommend against using it for new projects. Sep 28 15:53:03 devstack cinder-volume[75518]: If you are already using Eventlet, we recommend migrating to a different Sep 28 15:53:03 devstack cinder-volume[75518]: framework. For more detail see Sep 28 15:53:03 devstack cinder-volume[75518]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 15:53:03 devstack cinder-volume[75518]: import eventlet # noqa Sep 28 15:53:06 devstack cinder-volume[75518]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 15:53:06 devstack cinder-volume[75518]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 15:53:06 devstack cinder-volume[75518]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 15:53:07 devstack cinder-volume[75518]: INFO dbcounter [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Registered counter for database cinder Sep 28 15:53:07 devstack cinder-volume[75518]: DEBUG oslo_db.sqlalchemy.engines [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75518) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:53:07 devstack cinder-volume[75518]: DEBUG dbcounter [-] [75518] Writer thread running {{(pid=75518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 15:53:07 devstack cinder-volume[75518]: INFO cinder.rpc [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 15:53:07 devstack cinder-volume[75518]: INFO cinder.rpc [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_db.sqlalchemy.engines [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75518) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:53:08 devstack cinder-volume[75518]: INFO cinder.volume.manager [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Determined volume DB was empty at startup. Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG cinder.volume.manager [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75518) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 15:53:08 devstack cinder-volume[75518]: INFO cinder.volume.manager [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 15:53:08 devstack cinder-volume[75518]: WARNING stevedore.named [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 15:53:08 devstack cinder-volume[75518]: WARNING castellan.key_manager [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 15:53:08 devstack cinder-volume[75518]: WARNING cinder.keymgr.conf_key_mgr [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG cinder.volume.drivers.lvm [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75518) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] CMD "cinder-rtstool verify" returned: 0 in 0.400s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_db.sqlalchemy.engines [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75518) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:53:08 devstack cinder-volume[75518]: INFO cinder.rpc [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 15:53:08 devstack cinder-volume[75518]: INFO cinder.rpc [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 15:53:08 devstack cinder-volume[75518]: WARNING stevedore.named [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 15:53:08 devstack cinder-volume[75518]: WARNING castellan.key_manager [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 15:53:08 devstack cinder-volume[75518]: INFO cinder.volume.manager [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_db.sqlalchemy.engines [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75518) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:53:08 devstack cinder-volume[75518]: INFO oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Starting 1 workers Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Started child 75665 {{(pid=75518) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Full set of CONF: {{(pid=75518) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] ******************************************************************************** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Configuration options gathered from: {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] ================================================================================ {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] allow_availability_zone_fallback = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] allow_compression_on_image_upload = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] allowed_direct_url_schemes = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] api_rate_limit = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] auth_strategy = keystone {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] az_cache_duration = 3600 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_availability_zone = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_host = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_stats_polling_interval = 60 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backup_api_class = cinder.backup.api.API {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backup_name_template = backup-%s {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backup_use_same_host = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backup_use_temp_snapshot = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] chap_password = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] chap_username = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cinder_internal_tenant_project_id = 89ba6c25d9184fb08525094976fde19d {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cinder_internal_tenant_user_id = 94831c93ee7f4261a76dd84b56c54298 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cloned_volume_same_az = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cluster = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75665]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] compression_format = gzip {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] compute_api_class = cinder.compute.nova.API {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] config_dir = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] config_source = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] control_exchange = openstack {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] debug = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] default_availability_zone = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] default_group_type = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] default_volume_type = lvmdriver-1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] disk_geometry = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] driver_client_cert = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] driver_client_cert_key = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] driver_data_namespace = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] driver_ssl_cert_path = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] driver_ssl_cert_verify = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] driver_use_ssl = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] enable_force_upload = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] enable_new_services = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] enable_unsupported_driver = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] enforce_multipath_for_image_xfer = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] filter_function = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance_api_insecure = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance_api_servers = ['http://192.168.122.40/image'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance_api_ssl_compression = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance_ca_certificates_file = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance_catalog_info = image:glance:publicURL {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance_certfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance_keyfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance_num_retries = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance_request_timeout = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] goodness_function = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] graceful_shutdown_timeout = 5 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] group_api_class = cinder.group.api.API {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] host = devstack {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] image_compress_on_upload = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] image_conversion_address_space_limit = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] image_conversion_cpu_limit = 60 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] image_conversion_disable = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] image_introspection_address_space_limit = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] image_introspection_cpu_limit = 60 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] image_upload_use_cinder_backend = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] image_upload_use_internal_tenant = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] image_volume_cache_enabled = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] image_volume_cache_max_count = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] image_volume_cache_max_size_gb = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] init_host_max_objects_retrieval = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] instance_format = [instance: %(uuid)s] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] iscsi_target_flags = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] iscsi_write_cache = on {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] iser_helper = tgtadm {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] iser_ip_address = 192.168.122.40 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] iser_port = 3260 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] log_color = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] log_config_append = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] log_dir = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] log_file = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] log_options = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] log_rotate_interval = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] log_rotate_interval_type = days {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] log_rotation_type = none {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] max_age = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] max_logfile_count = 30 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] max_logfile_size_mb = 200 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] max_over_subscription_ratio = 20.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] message_reap_interval = 86400 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] message_ttl = 2592000 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] migration_create_volume_timeout_secs = 300 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] monkey_patch = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] monkey_patch_modules = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] my_ip = 192.168.122.40 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] no_snapshot_gb_quota = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] num_iser_scan_tries = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] num_shell_tries = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] num_volume_device_scan_tries = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] nvmeof_conn_info_version = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] nvmet_ns_id = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] nvmet_port_id = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] osapi_max_limit = 1000 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] osapi_volume_ext_list = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] osapi_volume_listen_port = 8776 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] osapi_volume_use_ssl = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] osapi_volume_workers = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] per_volume_size_limit = -1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] periodic_fuzzy_delay = 60 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] periodic_interval = 60 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] public_endpoint = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] publish_errors = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] quota_backup_gigabytes = 1000 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] quota_backups = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] quota_gigabytes = 1000 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] quota_groups = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] quota_snapshots = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] quota_volumes = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] rate_limit_burst = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] rate_limit_except_level = CRITICAL {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] rate_limit_interval = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] reinit_driver_count = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] replication_device = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] report_discard_supported = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] report_interval = 120 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] reservation_clean_interval = 86400 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] reservation_expire = 86400 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] reserved_image_namespaces = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] reserved_percentage = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] rpc_response_timeout = 120 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] run_external_periodic_tasks = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] scst_target_driver = iscsi {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] scst_target_iqn_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] service_down_time = 720 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] shell_completion = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] snapshot_name_template = snapshot-%s {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] snapshot_same_host = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] split_loggers = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] state_path = /opt/stack/data/cinder {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] storage_availability_zone = nova {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] storage_protocol = iSCSI {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] syslog_log_facility = LOG_USER {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] target_helper = lioadm {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] target_ip_address = 192.168.122.40 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] target_port = 3260 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] target_protocol = iscsi {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] target_secondary_ip_addresses = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] trace_flags = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] transport_url = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] until_refresh = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] use_chap_auth = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] use_default_quota_class = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] use_journal = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] use_json = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] use_multipath_for_image_xfer = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] use_stderr = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] use_syslog = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] verify_glance_signatures = enabled {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] volume_api_class = cinder.volume.api.API {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] volume_backend_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] volume_clear = zero {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] volume_clear_ionice = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] volume_clear_size = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] volume_copy_bps_limit = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] volume_dd_blocksize = 1M {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] volume_name_template = volume-%s {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] volume_service_inithost_offload = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] volume_usage_audit_period = month {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] zoning_mode = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_concurrency.disable_process_locking = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.auth_section = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.auth_type = password {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.auth_version = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.cache = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.certfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.include_service_catalog = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.insecure = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.interface = public {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.keyfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.memcache_password = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.memcache_username = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.region_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.service_type = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.40/identity {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.backend = dogpile.cache.null {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.backend_argument = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.backend_expiration_time = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.config_prefix = cache.oslo {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.debug_cache_backend = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.enable_retry_client = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.enable_socket_keepalive = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.enabled = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.expiration_time = 600 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.hashclient_retry_attempts = 2 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.memcache_dead_retry = 300 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.memcache_pool_maxsize = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.memcache_sasl_enabled = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.password = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.proxies = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.redis_db = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.redis_server = localhost:6379 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.retry_attempts = 2 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.retry_delay = 0.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.socket_keepalive_count = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.socket_keepalive_idle = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.socket_keepalive_interval = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.socket_timeout = 1.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.tls_allowed_ciphers = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.tls_cafile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.tls_certfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.tls_enabled = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.tls_keyfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cache.username = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] coordination.backend_url = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.asyncio_connection = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.asyncio_slave_connection = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.backend = sqlalchemy {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.connection = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.connection_debug = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.connection_parameters = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.connection_recycle_time = 3600 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.connection_trace = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.db_inc_retry_interval = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.db_max_retries = 20 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.db_max_retry_interval = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.db_retry_interval = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.max_overflow = 50 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75665]: INFO cinder.volume.manager [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.max_pool_size = 5 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.max_retries = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.mysql_wsrep_sync_wait = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.pool_timeout = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.retry_interval = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.slave_connection = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.sqlite_synchronous = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.synchronous_reader = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] database.use_db_reconnect = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_tracing.insecure = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] profiler.connection_string = messaging:// {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] profiler.enabled = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] profiler.es_doc_type = notification {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] profiler.es_scroll_size = 10000 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] profiler.es_scroll_time = 2m {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] profiler.filter_error_trace = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] profiler.hmac_keys = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] profiler.sentinel_service_name = mymaster {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] profiler.socket_timeout = 0.1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] profiler.trace_requests = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] profiler.trace_sqlalchemy = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] profiler_jaeger.process_tags = {} {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] profiler_jaeger.service_name_prefix = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] profiler_otlp.service_name_prefix = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_policy.enforce_new_defaults = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_policy.policy_default_rule = default {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_policy.policy_file = policy.yaml {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] privsep_osbrick.group = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] privsep_osbrick.helper_command = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] privsep_osbrick.user = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cinder_sys_admin.group = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cinder_sys_admin.helper_command = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] cinder_sys_admin.user = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] service_user.auth_section = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] service_user.auth_type = password {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] service_user.cafile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] service_user.certfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] service_user.collect_timing = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] service_user.insecure = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] service_user.keyfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] service_user.send_service_user_token = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] service_user.split_loggers = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] service_user.timeout = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] service_user.tls_ciphers = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] service_user.tls_min_version = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance.auth_section = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance.auth_type = password {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance.certfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance.collect_timing = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance.insecure = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance.keyfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance.region_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance.split_loggers = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance.timeout = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance.tls_ciphers = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] glance.tls_min_version = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.backend_availability_zone = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.chap_password = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.chap_username = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.disk_geometry = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.driver_client_cert = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.driver_client_cert_key = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.driver_data_namespace = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.driver_use_ssl = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.extra_capabilities = {} {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.filter_function = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.goodness_function = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.iscsi_target_flags = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.iscsi_write_cache = on {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.iser_helper = tgtadm {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.iser_ip_address = 192.168.122.40 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.iser_port = 3260 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.lvm_share_target = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.lvm_type = auto {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.num_shell_tries = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.replication_device = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.report_discard_supported = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.reserved_percentage = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.target_helper = tgtadm {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.target_ip_address = 192.168.122.40 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.target_port = 3260 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.target_protocol = iscsi {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.trace_flags = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.unique_fqdn_network = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.use_chap_auth = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.volume_backend_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.volume_clear = zero {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.volume_clear_ionice = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.volume_clear_size = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_reports.file_event_handler = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_reports.log_dir = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.backend_host = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.chap_password = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.chap_username = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.disk_geometry = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.driver_client_cert = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.extra_capabilities = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.filter_function = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.goodness_function = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.iser_helper = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.iser_ip_address = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.iser_port = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.lvm_share_target = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.lvm_type = auto {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.num_shell_tries = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.replication_device = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.report_discard_supported = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.reserved_percentage = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.scst_target_driver = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.storage_protocol = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.target_helper = lioadm {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.target_ip_address = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.target_port = 3260 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.trace_flags = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.use_chap_auth = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.064s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.volume_clear = zero {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.volume_clear_size = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] lvmdriver-1.volumes_dir = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.ssl = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_notifications.driver = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_notifications.retry = -1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] key_manager.fixed_key = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican.barbican_api_version = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican.barbican_endpoint = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican.barbican_endpoint_type = public {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican.barbican_region_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican.cafile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican.certfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican.collect_timing = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican.insecure = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican.keyfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican.number_of_retries = 60 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican.retry_delay = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican.send_service_user_token = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican.split_loggers = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican.timeout = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican.tls_ciphers = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican.tls_min_version = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican.verify_ssl = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican.verify_ssl_path = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican_service_user.auth_section = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican_service_user.auth_type = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican_service_user.cafile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican_service_user.certfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:08 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican_service_user.collect_timing = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican_service_user.insecure = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican_service_user.keyfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican_service_user.split_loggers = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican_service_user.timeout = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican_service_user.tls_ciphers = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] barbican_service_user.tls_min_version = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.055s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] vault.approle_role_id = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] vault.approle_secret_id = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] vault.auth_method = approle {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] vault.auth_path = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] vault.kv_mountpoint = secret {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] vault.kv_path = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] vault.kv_version = 2 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] vault.namespace = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] vault.root_token_id = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] vault.ssl_ca_crt_file = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] vault.timeout = 60.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] vault.token_file = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] vault.token_role = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] vault.use_ssl = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:09 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] ******************************************************************************** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 15:53:09 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:09 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:09 devstack sudo[75670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 15:53:09 devstack sudo[75670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:09 devstack sudo[75670]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:09 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.354s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:09 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:09 devstack sudo[75675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:53:09 devstack sudo[75675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:09 devstack sudo[75675]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:09 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.264s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:09 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:53:09 devstack cinder-volume[75665]: INFO cinder.brick.local_dev.lvm [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 15:53:09 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:09 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:09 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:09 devstack sudo[75785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:53:09 devstack sudo[75785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:09 devstack sudo[75785]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:09 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:09 devstack cinder-volume[75665]: DEBUG cinder.brick.local_dev.lvm [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75665) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 15:53:09 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:09 devstack sudo[75883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:53:09 devstack sudo[75883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:10 devstack sudo[75883]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:10 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:10 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:10 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:10 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:10 devstack sudo[76085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:53:10 devstack sudo[76085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:10 devstack sudo[76085]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:10 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:10 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:10 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:10 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:10 devstack sudo[76193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 15:53:10 devstack sudo[76193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:11 devstack sudo[76193]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:11 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.268s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:11 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:11 devstack sudo[76284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:53:11 devstack sudo[76284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:11 devstack sudo[76284]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:11 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:11 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:11 devstack sudo[76287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:53:11 devstack sudo[76287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:11 devstack sudo[76287]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:11 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:11 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:11 devstack sudo[76371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:53:11 devstack sudo[76371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:11 devstack sudo[76371]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:11 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:11 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:11 devstack sudo[76374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:53:11 devstack sudo[76374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:12 devstack sudo[76374]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:12 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:12 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:12 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:12 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:12 devstack sudo[76417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:53:12 devstack sudo[76417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:12 devstack sudo[76417]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:12 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:12 devstack cinder-volume[75665]: INFO cinder.volume.drivers.lvm [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 15:53:12 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:12 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:12 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:12 devstack sudo[76468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:53:12 devstack sudo[76468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:12 devstack sudo[76468]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:12 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:12 devstack cinder-volume[75665]: DEBUG cinder.volume.drivers.lvm [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Updating volume stats {{(pid=75665) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 15:53:12 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:12 devstack sudo[76471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:53:12 devstack sudo[76471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:13 devstack sudo[76471]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:13 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:13 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:13 devstack sudo[76474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:53:13 devstack sudo[76474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:13 devstack sudo[76474]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:13 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:13 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:13 devstack sudo[76483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:53:13 devstack sudo[76483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:13 devstack sudo[76483]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:13 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:13 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:13 devstack sudo[76486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:53:13 devstack sudo[76486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:13 devstack sudo[76486]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:13 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:13 devstack cinder-volume[75665]: INFO cinder.volume.driver [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Driver hasn't implemented _init_vendor_properties() Sep 28 15:53:13 devstack cinder-volume[75665]: DEBUG cinder.volume.driver [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75665) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 15:53:13 devstack cinder-volume[75665]: DEBUG oslo_db.sqlalchemy.engines [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75665) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:53:13 devstack cinder-volume[75665]: DEBUG dbcounter [-] [75665] Writer thread running {{(pid=75665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 15:53:14 devstack cinder-volume[75665]: DEBUG cinder.db.api [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Building query based on filter {{(pid=75665) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 15:53:14 devstack cinder-volume[75665]: DEBUG cinder.image.image_utils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75665) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 15:53:14 devstack cinder-volume[75665]: INFO cinder.keymgr.migration [None req-c08d98aa-e72d-4f0b-bf41-111254e430d1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 15:53:14 devstack cinder-volume[75665]: DEBUG cinder.volume.drivers.lvm [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Updating volume stats {{(pid=75665) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 15:53:14 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:14 devstack sudo[76490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:53:14 devstack sudo[76490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:14 devstack sudo[76490]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:14 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:14 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:14 devstack sudo[76493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:53:14 devstack sudo[76493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:14 devstack sudo[76493]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:14 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:14 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:14 devstack sudo[76499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:53:14 devstack sudo[76499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:14 devstack sudo[76499]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:14 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:14 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:14 devstack sudo[76502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:53:14 devstack sudo[76502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:15 devstack sudo[76502]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:15 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:15 devstack cinder-volume[75665]: DEBUG cinder.manager [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Notifying Schedulers of capabilities ... {{(pid=75665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:53:15 devstack cinder-volume[75665]: INFO cinder.volume.manager [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Driver initialization completed successfully. Sep 28 15:53:15 devstack cinder-volume[75665]: INFO cinder.manager [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Initiating service 2 cleanup Sep 28 15:53:15 devstack cinder-volume[75665]: INFO cinder.manager [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Service 2 cleanup completed. Sep 28 15:53:15 devstack cinder-volume[75665]: DEBUG cinder.service [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Creating RPC server for service cinder-volume {{(pid=75665) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 15:53:15 devstack cinder-volume[75665]: DEBUG cinder.service [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75665) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 15:53:15 devstack cinder-volume[75665]: INFO cinder.volume.manager [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 15:53:15 devstack cinder-volume[75665]: DEBUG cinder.volume.drivers.lvm [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Updating volume stats {{(pid=75665) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 15:53:15 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:15 devstack sudo[76506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:53:15 devstack sudo[76506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:15 devstack sudo[76506]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:15 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:15 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:15 devstack sudo[76509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:53:15 devstack sudo[76509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:15 devstack sudo[76509]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:15 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:15 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:15 devstack sudo[76514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:53:15 devstack sudo[76514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:16 devstack sudo[76514]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:16 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.312s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:16 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:16 devstack sudo[76517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:53:16 devstack sudo[76517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:16 devstack sudo[76517]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:16 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:16 devstack cinder-volume[75665]: INFO cinder.volume.manager [None req-8b6e2086-4433-40df-ac7f-791c249da54f None None] Driver post RPC initialization completed successfully. Sep 28 15:53:18 devstack cinder-volume[75518]: DEBUG dbcounter [-] [75518] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:53:26 devstack cinder-volume[75665]: DEBUG dbcounter [-] [75665] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:53:26 devstack cinder-volume[75665]: DEBUG dbcounter [-] [75665] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:54:00 devstack cinder-volume[75665]: DEBUG oslo_service.periodic_task [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Running periodic task VolumeManager._thread_info {{(pid=75665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:54:00 devstack cinder-volume[75665]: DEBUG cinder.volume.manager [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] thread count: 6 {{(pid=75665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:54:00 devstack cinder-volume[75665]: DEBUG cinder.volume.manager [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] thread info: [<_MainThread(MainThread, started 137917073895552)>, , , , , ] {{(pid=75665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:55:00 devstack cinder-volume[75665]: DEBUG oslo_service.periodic_task [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:55:00 devstack cinder-volume[75665]: DEBUG cinder.volume.drivers.lvm [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Updating volume stats {{(pid=75665) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 15:55:00 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:55:00 devstack sudo[81599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:55:00 devstack sudo[81599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:55:00 devstack sudo[81599]: pam_unix(sudo:session): session closed for user root Sep 28 15:55:00 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:55:00 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:55:00 devstack sudo[81602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:55:00 devstack sudo[81602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:55:01 devstack sudo[81602]: pam_unix(sudo:session): session closed for user root Sep 28 15:55:01 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:55:01 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:55:01 devstack sudo[81605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:55:01 devstack sudo[81605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:55:01 devstack sudo[81605]: pam_unix(sudo:session): session closed for user root Sep 28 15:55:01 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:55:01 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:55:01 devstack sudo[81608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:55:01 devstack sudo[81608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:55:01 devstack sudo[81608]: pam_unix(sudo:session): session closed for user root Sep 28 15:55:01 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:55:01 devstack cinder-volume[75665]: DEBUG cinder.manager [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Notifying Schedulers of capabilities ... {{(pid=75665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:55:01 devstack cinder-volume[75665]: DEBUG oslo_service.periodic_task [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Running periodic task VolumeManager._thread_info {{(pid=75665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:55:01 devstack cinder-volume[75665]: DEBUG cinder.volume.manager [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] thread count: 6 {{(pid=75665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:55:01 devstack cinder-volume[75665]: DEBUG cinder.volume.manager [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] thread info: [<_MainThread(MainThread, started 137917073895552)>, , , , , ] {{(pid=75665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:55:26 devstack cinder-volume[75665]: DEBUG dbcounter [-] [75665] Writing DB stats cinder:SELECT=1 {{(pid=75665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:55:26 devstack cinder-volume[75665]: DEBUG dbcounter [-] [75665] Writing DB stats cinder:UPDATE=1 {{(pid=75665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:56:00 devstack cinder-volume[75665]: DEBUG oslo_service.periodic_task [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:56:00 devstack cinder-volume[75665]: DEBUG cinder.volume.drivers.lvm [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Updating volume stats {{(pid=75665) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 15:56:00 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:00 devstack sudo[83746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:56:00 devstack sudo[83746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:00 devstack sudo[83746]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:00 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:00 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:00 devstack sudo[83750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:56:00 devstack sudo[83750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:01 devstack sudo[83750]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:01 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:01 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:01 devstack sudo[83762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:56:01 devstack sudo[83762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:01 devstack sudo[83762]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:01 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:01 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:01 devstack sudo[83765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:56:01 devstack sudo[83765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:01 devstack sudo[83765]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:01 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:01 devstack cinder-volume[75665]: DEBUG cinder.manager [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Notifying Schedulers of capabilities ... {{(pid=75665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:57:00 devstack cinder-volume[75665]: DEBUG oslo_service.periodic_task [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:57:00 devstack cinder-volume[75665]: DEBUG cinder.volume.drivers.lvm [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Updating volume stats {{(pid=75665) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 15:57:00 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:00 devstack sudo[85111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:57:00 devstack sudo[85111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:00 devstack sudo[85111]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:00 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:00 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:00 devstack sudo[85114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:57:00 devstack sudo[85114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:01 devstack sudo[85114]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:01 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:01 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:01 devstack sudo[85132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:57:01 devstack sudo[85132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:01 devstack sudo[85132]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:01 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:01 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:01 devstack sudo[85143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:57:01 devstack sudo[85143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:01 devstack sudo[85143]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:01 devstack cinder-volume[75665]: DEBUG oslo_concurrency.processutils [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:01 devstack cinder-volume[75665]: DEBUG cinder.manager [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Notifying Schedulers of capabilities ... {{(pid=75665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:57:01 devstack cinder-volume[75665]: DEBUG oslo_service.periodic_task [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] Running periodic task VolumeManager._thread_info {{(pid=75665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:57:01 devstack cinder-volume[75665]: DEBUG cinder.volume.manager [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] thread count: 6 {{(pid=75665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:57:01 devstack cinder-volume[75665]: DEBUG cinder.volume.manager [None req-8232ddc5-58b5-46c1-8f02-309a9c5a4703 None None] thread info: [<_MainThread(MainThread, started 137917073895552)>, , , , , ] {{(pid=75665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:57:26 devstack cinder-volume[75665]: DEBUG dbcounter [-] [75665] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:57:42 devstack cinder-volume[75518]: INFO oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Caught SIGTERM, stopping children Sep 28 15:57:42 devstack cinder-volume[75518]: DEBUG oslo_concurrency.lockutils [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Acquiring lock "singleton_lock" {{(pid=75518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 15:57:42 devstack cinder-volume[75518]: DEBUG oslo_concurrency.lockutils [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Acquired lock "singleton_lock" {{(pid=75518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 15:57:42 devstack cinder-volume[75518]: DEBUG oslo_concurrency.lockutils [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Releasing lock "singleton_lock" {{(pid=75518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 15:57:42 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Stop services. {{(pid=75518) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 15:57:42 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Killing children. {{(pid=75518) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 15:57:42 devstack cinder-volume[75518]: INFO oslo_service.backend._eventlet.service [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Waiting on 1 children to exit Sep 28 15:57:47 devstack cinder-volume[75665]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 28 15:57:48 devstack cinder-volume[86021]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 15:57:48 devstack cinder-volume[86021]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 15:57:48 devstack cinder-volume[86021]: we strongly recommend against using it for new projects. Sep 28 15:57:48 devstack cinder-volume[86021]: If you are already using Eventlet, we recommend migrating to a different Sep 28 15:57:48 devstack cinder-volume[86021]: framework. For more detail see Sep 28 15:57:48 devstack cinder-volume[86021]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 15:57:48 devstack cinder-volume[86021]: import eventlet # noqa Sep 28 15:57:50 devstack cinder-volume[86021]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86021) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 15:57:50 devstack cinder-volume[86021]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86021) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 15:57:50 devstack cinder-volume[86021]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86021) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 15:57:50 devstack cinder-volume[75665]: DEBUG oslo_concurrency.lockutils [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Acquiring lock "singleton_lock" {{(pid=75665) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 15:57:50 devstack cinder-volume[75665]: DEBUG oslo_concurrency.lockutils [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Acquired lock "singleton_lock" {{(pid=75665) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 15:57:50 devstack cinder-volume[75665]: DEBUG oslo_concurrency.lockutils [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Releasing lock "singleton_lock" {{(pid=75665) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 15:57:50 devstack cinder-volume[75665]: WARNING amqp [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 15:57:50 devstack cinder-volume[75665]: WARNING amqp [None req-c78fa6d0-6fe7-4aa6-b4fe-ea69c74fad31 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 15:57:51 devstack cinder-volume[86021]: INFO dbcounter [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Registered counter for database cinder Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_db.sqlalchemy.engines [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86021) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG dbcounter [-] [86021] Writer thread running {{(pid=86021) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 15:57:51 devstack cinder-volume[86021]: INFO cinder.rpc [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 15:57:51 devstack cinder-volume[86021]: INFO cinder.rpc [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_db.sqlalchemy.engines [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86021) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:57:51 devstack cinder-volume[86021]: INFO cinder.volume.manager [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Determined volume DB was empty at startup. Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG cinder.volume.manager [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86021) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 15:57:51 devstack cinder-volume[86021]: INFO cinder.volume.manager [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 15:57:51 devstack cinder-volume[86021]: WARNING stevedore.named [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 15:57:51 devstack cinder-volume[86021]: WARNING castellan.key_manager [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 15:57:51 devstack cinder-volume[86021]: WARNING cinder.keymgr.conf_key_mgr [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 15:57:51 devstack cinder-volume[86021]: INFO cinder.volume.manager [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_db.sqlalchemy.engines [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86021) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:57:51 devstack cinder-volume[86021]: INFO oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Starting 1 workers Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Started child 86244 {{(pid=86021) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Full set of CONF: {{(pid=86021) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] ******************************************************************************** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Configuration options gathered from: {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] ================================================================================ {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] allow_availability_zone_fallback = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] allow_compression_on_image_upload = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] allowed_direct_url_schemes = [] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] api_rate_limit = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] auth_strategy = keystone {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86244]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_availability_zone = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_host = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_name = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_stats_polling_interval = 60 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backup_api_class = cinder.backup.api.API {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backup_name_template = backup-%s {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backup_use_same_host = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backup_use_temp_snapshot = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] chap_password = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] chap_username = {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cinder_internal_tenant_project_id = 89ba6c25d9184fb08525094976fde19d {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cinder_internal_tenant_user_id = 94831c93ee7f4261a76dd84b56c54298 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cluster = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] compression_format = gzip {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] compute_api_class = cinder.compute.nova.API {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] config_dir = [] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] config_source = [] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] control_exchange = openstack {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] debug = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] default_availability_zone = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] default_group_type = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] default_volume_type = QuobyteHD {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] disk_geometry = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] driver_client_cert = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] driver_client_cert_key = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] driver_data_namespace = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] driver_ssl_cert_path = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] driver_ssl_cert_verify = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] driver_use_ssl = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] enable_new_services = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] enable_unsupported_driver = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] enabled_backends = ['QuobyteHD'] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] enforce_multipath_for_image_xfer = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] filter_function = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance_api_insecure = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance_api_servers = ['http://192.168.122.40/image'] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance_api_ssl_compression = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance_ca_certificates_file = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance_catalog_info = image:glance:publicURL {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance_certfile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance_keyfile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance_num_retries = 3 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance_request_timeout = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] goodness_function = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] graceful_shutdown_timeout = 5 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] group_api_class = cinder.group.api.API {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] host = devstack {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] image_compress_on_upload = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] image_conversion_address_space_limit = 1 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] image_conversion_cpu_limit = 60 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] image_conversion_disable = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] image_introspection_address_space_limit = 1 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] image_introspection_cpu_limit = 60 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] image_upload_use_cinder_backend = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] image_upload_use_internal_tenant = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] image_volume_cache_enabled = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] image_volume_cache_max_count = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] image_volume_cache_max_size_gb = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:51 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] init_host_max_objects_retrieval = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] instance_format = [instance: %(uuid)s] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] iscsi_target_flags = {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86244]: INFO cinder.volume.manager [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 15:57:52 devstack cinder-volume[86244]: DEBUG cinder.volume.drivers.remotefs [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86244) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] iscsi_write_cache = on {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] iser_helper = tgtadm {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] iser_ip_address = 192.168.122.40 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] iser_port = 3260 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] log_color = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] log_config_append = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] log_dir = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] log_file = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] log_options = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] log_rotate_interval = 1 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] log_rotate_interval_type = days {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] log_rotation_type = none {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] max_age = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] max_logfile_count = 30 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] max_logfile_size_mb = 200 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] max_over_subscription_ratio = 20.0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] message_reap_interval = 86400 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] message_ttl = 2592000 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] migration_create_volume_timeout_secs = 300 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] monkey_patch = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] monkey_patch_modules = [] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] my_ip = 192.168.122.40 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] no_snapshot_gb_quota = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] num_iser_scan_tries = 3 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] num_shell_tries = 3 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] num_volume_device_scan_tries = 3 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] nvmeof_conn_info_version = 1 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] nvmet_ns_id = 10 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] nvmet_port_id = 1 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] osapi_max_limit = 1000 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] osapi_volume_ext_list = [] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] osapi_volume_listen = 0.0.0.0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] osapi_volume_listen_port = 8776 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] osapi_volume_use_ssl = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] osapi_volume_workers = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] per_volume_size_limit = -1 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] periodic_fuzzy_delay = 60 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] periodic_interval = 60 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] project_id_regex = [0-9a-f\-]+ {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] public_endpoint = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] publish_errors = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] quota_backup_gigabytes = 1000 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] quota_backups = 10 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] quota_gigabytes = 1000 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] quota_groups = 10 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] quota_snapshots = 10 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] quota_volumes = 10 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] rate_limit_burst = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] rate_limit_except_level = CRITICAL {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] rate_limit_interval = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] reinit_driver_count = 3 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] replication_device = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] report_discard_supported = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] report_interval = 120 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] reservation_clean_interval = 86400 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] reservation_expire = 86400 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] reserved_image_namespaces = [] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] reserved_percentage = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] rpc_response_timeout = 120 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] run_external_periodic_tasks = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] scst_target_driver = iscsi {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] scst_target_iqn_name = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] service_down_time = 720 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] shell_completion = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] snapshot_name_template = snapshot-%s {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] split_loggers = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] state_path = /opt/stack/data/cinder {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] storage_availability_zone = nova {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] storage_protocol = iSCSI {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] syslog_log_facility = LOG_USER {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] target_helper = lioadm {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] target_ip_address = 192.168.122.40 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] target_port = 3260 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] target_protocol = iscsi {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] target_secondary_ip_addresses = [] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] trace_flags = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] transfer_api_class = cinder.transfer.api.API {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86244]: DEBUG cinder.volume.drivers.quobyte [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86244) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 15:57:52 devstack cinder-volume[86244]: WARNING cinder.volume.drivers.quobyte [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 15:57:52 devstack cinder-volume[86244]: WARNING cinder.volume.drivers.quobyte [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 15:57:52 devstack cinder-volume[86244]: DEBUG oslo_concurrency.processutils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Running cmd (subprocess): mount.quobyte {{(pid=86244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] transport_url = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] until_refresh = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] use_chap_auth = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] use_default_quota_class = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] use_journal = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] use_json = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] use_multipath_for_image_xfer = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] use_stderr = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] use_syslog = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] verify_glance_signatures = enabled {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] volume_api_class = cinder.volume.api.API {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] volume_backend_name = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] volume_clear = zero {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] volume_clear_ionice = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] volume_clear_size = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] volume_copy_bps_limit = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] volume_dd_blocksize = 1M {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] volume_name_template = volume-%s {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] volume_service_inithost_offload = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] volume_usage_audit_period = month {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] zoning_mode = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_concurrency.disable_process_locking = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.auth_section = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.auth_type = password {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.auth_version = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.cache = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.certfile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.delay_auth_decision = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.http_connect_timeout = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.include_service_catalog = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.insecure = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.interface = public {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.keyfile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.memcache_password = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.memcache_username = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.region_name = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.service_token_roles_required = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.service_type = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.token_cache_time = 300 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.40/identity {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.backend = dogpile.cache.null {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.backend_argument = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.backend_expiration_time = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.config_prefix = cache.oslo {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.debug_cache_backend = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.enable_retry_client = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.enable_socket_keepalive = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.enabled = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.expiration_time = 600 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.hashclient_retry_attempts = 2 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.memcache_dead_retry = 300 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.memcache_pool_maxsize = 10 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.memcache_sasl_enabled = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.password = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.proxies = [] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.redis_db = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.redis_sentinel_service_name = mymaster {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.redis_server = localhost:6379 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.retry_attempts = 2 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.retry_delay = 0.0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.socket_keepalive_count = 1 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.socket_keepalive_idle = 1 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.socket_keepalive_interval = 1 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.socket_timeout = 1.0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.tls_allowed_ciphers = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.tls_cafile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.tls_certfile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.tls_enabled = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.tls_keyfile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cache.username = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] coordination.backend_url = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.asyncio_connection = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.asyncio_slave_connection = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.backend = sqlalchemy {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.connection = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.connection_debug = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.connection_parameters = {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.connection_recycle_time = 3600 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.connection_trace = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.db_inc_retry_interval = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.db_max_retries = 20 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.db_max_retry_interval = 10 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.db_retry_interval = 1 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.max_overflow = 50 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.max_pool_size = 5 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.max_retries = 10 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.mysql_wsrep_sync_wait = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.pool_timeout = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.retry_interval = 10 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.slave_connection = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.sqlite_synchronous = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.synchronous_reader = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] database.use_db_reconnect = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_tracing.insecure = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack quobyte-client[86245]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] profiler.connection_string = messaging:// {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] profiler.enabled = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] profiler.es_doc_type = notification {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] profiler.es_scroll_size = 10000 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack quobyte-client[86245]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] profiler.es_scroll_time = 2m {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] profiler.filter_error_trace = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] profiler.hmac_keys = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] profiler.sentinel_service_name = mymaster {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] profiler.socket_timeout = 0.1 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] profiler.trace_requests = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] profiler.trace_sqlalchemy = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] profiler_jaeger.process_tags = {} {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] profiler_jaeger.service_name_prefix = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] profiler_otlp.service_name_prefix = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_policy.enforce_new_defaults = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_policy.policy_default_rule = default {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_policy.policy_file = policy.yaml {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_policy.remote_timeout = 60.0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] privsep_osbrick.group = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] privsep_osbrick.helper_command = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] privsep_osbrick.user = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cinder_sys_admin.group = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cinder_sys_admin.helper_command = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86244]: DEBUG oslo_concurrency.processutils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] CMD "mount.quobyte" returned: 1 in 0.140s {{(pid=86244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] cinder_sys_admin.user = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] service_user.auth_section = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] service_user.auth_type = password {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] service_user.cafile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] service_user.certfile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] service_user.collect_timing = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] service_user.insecure = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] service_user.keyfile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] service_user.send_service_user_token = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] service_user.split_loggers = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] service_user.timeout = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] service_user.tls_ciphers = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] service_user.tls_min_version = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance.auth_section = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance.auth_type = password {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance.certfile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance.collect_timing = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86244]: DEBUG oslo_concurrency.lockutils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance.insecure = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance.keyfile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86244]: DEBUG oslo_concurrency.lockutils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance.region_name = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86244]: DEBUG cinder.volume.drivers.quobyte [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=86244) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance.split_loggers = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance.timeout = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance.tls_ciphers = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] glance.tls_min_version = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.backend_availability_zone = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.chap_password = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.chap_username = {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.disk_geometry = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.driver_client_cert = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.driver_client_cert_key = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86244]: INFO cinder.volume.drivers.quobyte [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f ... Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.driver_data_namespace = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.driver_use_ssl = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.enable_unsupported_driver = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.extra_capabilities = {} {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.filter_function = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.goodness_function = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.iscsi_target_flags = {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.iscsi_write_cache = on {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.iser_helper = tgtadm {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.iser_ip_address = 192.168.122.40 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.iser_port = 3260 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86244]: DEBUG oslo_concurrency.processutils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 -c /etc/quobyte/client-cinder.cfg {{(pid=86244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.nas_host = {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.nas_login = admin {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.nas_mount_options = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.nas_password = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.nas_private_key = {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.nas_share_path = {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.nas_ssh_port = 22 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.num_shell_tries = 3 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.nvmet_port_id = 1 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.quobyte_client_cfg = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.quobyte_volume_url = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.replication_device = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.report_discard_supported = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.reserved_percentage = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.scst_target_driver = iscsi {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.scst_target_iqn_name = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.storage_protocol = iSCSI {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.target_helper = tgtadm {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.target_ip_address = 192.168.122.40 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.target_port = 3260 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.target_protocol = iscsi {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.trace_flags = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.unique_fqdn_network = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.use_chap_auth = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.volume_backend_name = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.volume_clear = zero {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.volume_clear_ionice = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.volume_clear_size = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_reports.file_event_handler = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_reports.log_dir = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.backend_availability_zone = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.backend_host = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.chap_password = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.chap_username = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.chiscsi_conf = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.disk_geometry = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.driver_client_cert = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.driver_client_cert_key = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.driver_data_namespace = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.driver_use_ssl = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.extra_capabilities = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.filter_function = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.goodness_function = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.iscsi_target_flags = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.iscsi_write_cache = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.iser_helper = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.iser_ip_address = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.iser_port = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.iser_target_prefix = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.nas_host = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.nas_login = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.nas_mount_options = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.nas_password = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.nas_private_key = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.nas_share_path = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.nas_ssh_port = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.num_shell_tries = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.nvmet_ns_id = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.nvmet_port_id = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.replication_device = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.report_discard_supported = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.reserved_percentage = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.scst_target_driver = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.storage_protocol = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.target_helper = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.target_ip_address = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.target_port = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.target_prefix = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.target_protocol = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.trace_flags = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.unique_fqdn_network = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.use_chap_auth = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.volume_clear = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.volume_clear_ionice = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.volume_clear_size = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack sudo[86250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 -c /etc/quobyte/client-cinder.cfg Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] QuobyteHD.volumes_dir = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack sudo[86250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.ssl = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.ssl_version = {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_notifications.driver = [] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_notifications.retry = -1 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] oslo_messaging_notifications.transport_url = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] key_manager.fixed_key = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican.barbican_api_version = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican.barbican_endpoint = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican.barbican_endpoint_type = public {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican.barbican_region_name = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican.cafile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican.certfile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican.collect_timing = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican.insecure = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican.keyfile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican.number_of_retries = 60 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican.retry_delay = 1 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican.send_service_user_token = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican.split_loggers = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican.timeout = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican.tls_ciphers = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican.tls_min_version = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican.verify_ssl = True {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican.verify_ssl_path = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican_service_user.auth_section = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican_service_user.auth_type = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican_service_user.cafile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican_service_user.certfile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican_service_user.collect_timing = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican_service_user.insecure = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican_service_user.keyfile = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican_service_user.split_loggers = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican_service_user.timeout = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican_service_user.tls_ciphers = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] barbican_service_user.tls_min_version = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] vault.approle_role_id = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] vault.approle_secret_id = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] vault.auth_method = approle {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] vault.auth_path = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] vault.kv_mountpoint = secret {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] vault.kv_path = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] vault.kv_version = 2 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] vault.namespace = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] vault.root_token_id = **** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] vault.ssl_ca_crt_file = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] vault.timeout = 60.0 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] vault.token_file = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] vault.token_role = None {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] vault.use_ssl = False {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:57:52 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] ******************************************************************************** {{(pid=86021) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 15:57:52 devstack sudo[86250]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:52 devstack cinder-volume[86244]: DEBUG oslo_concurrency.processutils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.445s {{(pid=86244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:52 devstack cinder-volume[86244]: INFO cinder.volume.drivers.quobyte [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f succeeded Sep 28 15:57:52 devstack cinder-volume[86244]: DEBUG cinder.volume.drivers.quobyte [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=86244) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:57:52 devstack cinder-volume[86244]: DEBUG oslo_concurrency.lockutils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.461s {{(pid=86244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:52 devstack cinder-volume[86244]: DEBUG oslo_concurrency.processutils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=86244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:52 devstack sudo[86352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 15:57:52 devstack sudo[86352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:52 devstack sudo[86352]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:52 devstack cinder-volume[86244]: DEBUG oslo_concurrency.processutils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.248s {{(pid=86244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:52 devstack cinder-volume[86244]: INFO cinder.volume.driver [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 15:57:52 devstack cinder-volume[86244]: DEBUG cinder.volume.driver [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1790084838867, 'free_capacity_gb': 1775.1790084838867, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86244) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG oslo_db.sqlalchemy.engines [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86244) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG dbcounter [-] [86244] Writer thread running {{(pid=86244) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG cinder.db.api [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Building query based on filter {{(pid=86244) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG cinder.image.image_utils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86244) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 15:57:53 devstack cinder-volume[86244]: INFO cinder.keymgr.migration [None req-9c9debdb-e668-431c-aee9-3d4951ab02f8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG oslo_concurrency.lockutils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG oslo_concurrency.lockutils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG cinder.volume.drivers.quobyte [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=86244) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG cinder.volume.drivers.quobyte [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=86244) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG oslo_concurrency.lockutils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG oslo_concurrency.processutils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=86244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:53 devstack sudo[86355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 15:57:53 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:53 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG oslo_concurrency.processutils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.252s {{(pid=86244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG cinder.manager [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Notifying Schedulers of capabilities ... {{(pid=86244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:57:53 devstack cinder-volume[86244]: INFO cinder.volume.manager [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Driver initialization completed successfully. Sep 28 15:57:53 devstack cinder-volume[86244]: INFO cinder.manager [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Initiating service 3 cleanup Sep 28 15:57:53 devstack cinder-volume[86244]: INFO cinder.manager [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Service 3 cleanup completed. Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG cinder.service [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Creating RPC server for service cinder-volume {{(pid=86244) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG cinder.service [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86244) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 15:57:53 devstack cinder-volume[86244]: INFO cinder.volume.manager [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG oslo_concurrency.lockutils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG oslo_concurrency.lockutils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG cinder.volume.drivers.quobyte [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=86244) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG cinder.volume.drivers.quobyte [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=86244) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG oslo_concurrency.lockutils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG oslo_concurrency.processutils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=86244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:53 devstack sudo[86358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 15:57:53 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:53 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:53 devstack cinder-volume[86244]: DEBUG oslo_concurrency.processutils [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.347s {{(pid=86244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:53 devstack cinder-volume[86244]: INFO cinder.volume.manager [None req-2c957e99-7f6a-4f71-b709-6aade3f50d34 None None] Driver post RPC initialization completed successfully. Sep 28 15:57:58 devstack cinder-volume[86244]: DEBUG oslo_concurrency.lockutils [None req-4815e8e7-3469-444b-9c6a-84c236e855c7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:58 devstack cinder-volume[86244]: DEBUG oslo_concurrency.lockutils [None req-4815e8e7-3469-444b-9c6a-84c236e855c7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:58 devstack cinder-volume[86244]: DEBUG cinder.volume.drivers.quobyte [None req-4815e8e7-3469-444b-9c6a-84c236e855c7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=86244) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:57:58 devstack cinder-volume[86244]: DEBUG cinder.volume.drivers.quobyte [None req-4815e8e7-3469-444b-9c6a-84c236e855c7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=86244) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:57:58 devstack cinder-volume[86244]: DEBUG oslo_concurrency.lockutils [None req-4815e8e7-3469-444b-9c6a-84c236e855c7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:58 devstack cinder-volume[86244]: DEBUG oslo_concurrency.processutils [None req-4815e8e7-3469-444b-9c6a-84c236e855c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=86244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:58 devstack sudo[86566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 15:57:58 devstack sudo[86566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:58 devstack sudo[86566]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:58 devstack cinder-volume[86244]: DEBUG oslo_concurrency.processutils [None req-4815e8e7-3469-444b-9c6a-84c236e855c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.235s {{(pid=86244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:58 devstack cinder-volume[86244]: DEBUG cinder.manager [None req-4815e8e7-3469-444b-9c6a-84c236e855c7 None None] Notifying Schedulers of capabilities ... {{(pid=86244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:58:00 devstack cinder-volume[86021]: INFO oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Caught SIGTERM, stopping children Sep 28 15:58:00 devstack cinder-volume[86021]: DEBUG oslo_concurrency.lockutils [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Acquiring lock "singleton_lock" {{(pid=86021) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 15:58:00 devstack cinder-volume[86021]: DEBUG oslo_concurrency.lockutils [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Acquired lock "singleton_lock" {{(pid=86021) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 15:58:00 devstack cinder-volume[86021]: DEBUG oslo_concurrency.lockutils [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Releasing lock "singleton_lock" {{(pid=86021) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 15:58:00 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Stop services. {{(pid=86021) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 15:58:00 devstack cinder-volume[86021]: DEBUG oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Killing children. {{(pid=86021) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 15:58:00 devstack cinder-volume[86021]: INFO oslo_service.backend._eventlet.service [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Waiting on 1 children to exit Sep 28 15:58:03 devstack cinder-volume[86244]: DEBUG dbcounter [-] [86244] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86244) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:58:04 devstack cinder-volume[86244]: DEBUG dbcounter [-] [86244] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86244) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:58:05 devstack cinder-volume[86244]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 28 15:58:06 devstack cinder-volume[86803]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 15:58:06 devstack cinder-volume[86803]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 15:58:06 devstack cinder-volume[86803]: we strongly recommend against using it for new projects. Sep 28 15:58:06 devstack cinder-volume[86803]: If you are already using Eventlet, we recommend migrating to a different Sep 28 15:58:06 devstack cinder-volume[86803]: framework. For more detail see Sep 28 15:58:06 devstack cinder-volume[86803]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 15:58:06 devstack cinder-volume[86803]: import eventlet # noqa Sep 28 15:58:06 devstack cinder-volume[86244]: DEBUG oslo_concurrency.lockutils [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Acquiring lock "singleton_lock" {{(pid=86244) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 15:58:06 devstack cinder-volume[86244]: DEBUG oslo_concurrency.lockutils [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Acquired lock "singleton_lock" {{(pid=86244) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 15:58:06 devstack cinder-volume[86244]: DEBUG oslo_concurrency.lockutils [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Releasing lock "singleton_lock" {{(pid=86244) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 15:58:06 devstack cinder-volume[86244]: WARNING amqp [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 15:58:06 devstack cinder-volume[86244]: WARNING amqp [None req-9e4e5d7b-9ae4-4a6b-ad15-e76c165f9ecb None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 15:58:09 devstack cinder-volume[86803]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86803) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 15:58:09 devstack cinder-volume[86803]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86803) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 15:58:09 devstack cinder-volume[86803]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86803) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 15:58:10 devstack cinder-volume[86803]: INFO dbcounter [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] Registered counter for database cinder Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_db.sqlalchemy.engines [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86803) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG dbcounter [-] [86803] Writer thread running {{(pid=86803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 15:58:10 devstack cinder-volume[86803]: INFO cinder.rpc [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 15:58:10 devstack cinder-volume[86803]: INFO cinder.rpc [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_db.sqlalchemy.engines [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86803) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:58:10 devstack cinder-volume[86803]: INFO cinder.volume.manager [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] Determined volume DB was empty at startup. Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG cinder.volume.manager [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86803) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 15:58:10 devstack cinder-volume[86803]: WARNING stevedore.named [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 15:58:10 devstack cinder-volume[86803]: WARNING castellan.key_manager [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 15:58:10 devstack cinder-volume[86803]: WARNING cinder.keymgr.conf_key_mgr [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 15:58:10 devstack cinder-volume[86803]: INFO cinder.volume.manager [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_db.sqlalchemy.engines [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86803) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:58:10 devstack cinder-volume[86803]: INFO oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] Starting 1 workers Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] Started child 87087 {{(pid=86803) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] Full set of CONF: {{(pid=86803) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] ******************************************************************************** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] Configuration options gathered from: {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 15:58:10 devstack cinder-volume[87087]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] ================================================================================ {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] allow_availability_zone_fallback = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] allow_compression_on_image_upload = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] allowed_direct_url_schemes = [] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] api_rate_limit = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] auth_strategy = keystone {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_availability_zone = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_host = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_name = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_stats_polling_interval = 60 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backup_api_class = cinder.backup.api.API {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backup_name_template = backup-%s {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backup_use_same_host = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backup_use_temp_snapshot = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] chap_password = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] chap_username = {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cinder_internal_tenant_project_id = 89ba6c25d9184fb08525094976fde19d {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cinder_internal_tenant_user_id = 94831c93ee7f4261a76dd84b56c54298 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cluster = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] compression_format = gzip {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] compute_api_class = cinder.compute.nova.API {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] config_dir = [] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] config_source = [] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] control_exchange = openstack {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] debug = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] default_availability_zone = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] default_group_type = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] default_volume_type = QuobyteHD {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] disk_geometry = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] driver_client_cert = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] driver_client_cert_key = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] driver_data_namespace = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] driver_ssl_cert_path = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] driver_ssl_cert_verify = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] driver_use_ssl = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] enable_new_services = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] enable_unsupported_driver = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] enabled_backends = ['QuobyteHD'] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] enforce_multipath_for_image_xfer = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] filter_function = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance_api_insecure = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance_api_servers = ['http://192.168.122.40/image'] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance_api_ssl_compression = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance_ca_certificates_file = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance_catalog_info = image:glance:publicURL {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance_certfile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance_keyfile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance_num_retries = 3 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance_request_timeout = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] goodness_function = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] graceful_shutdown_timeout = 5 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] group_api_class = cinder.group.api.API {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] host = devstack {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] image_compress_on_upload = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] image_conversion_address_space_limit = 1 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] image_conversion_cpu_limit = 60 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] image_conversion_disable = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] image_introspection_address_space_limit = 1 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] image_introspection_cpu_limit = 60 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] image_upload_use_cinder_backend = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] image_upload_use_internal_tenant = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] image_volume_cache_enabled = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] image_volume_cache_max_count = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-159e3873-e652-438e-b635-248525e681c3 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] image_volume_cache_max_size_gb = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-159e3873-e652-438e-b635-248525e681c3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87087) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] init_host_max_objects_retrieval = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] instance_format = [instance: %(uuid)s] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] iscsi_target_flags = {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] iscsi_write_cache = on {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] iser_helper = tgtadm {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] iser_ip_address = 192.168.122.40 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] iser_port = 3260 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] log_color = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] log_config_append = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] log_dir = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] log_file = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] log_options = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] log_rotate_interval = 1 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] log_rotate_interval_type = days {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] log_rotation_type = none {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] max_age = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] max_logfile_count = 30 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] max_logfile_size_mb = 200 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] max_over_subscription_ratio = 20.0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] message_reap_interval = 86400 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] message_ttl = 2592000 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] migration_create_volume_timeout_secs = 300 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] monkey_patch = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] monkey_patch_modules = [] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] my_ip = 192.168.122.40 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] no_snapshot_gb_quota = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] num_iser_scan_tries = 3 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] num_shell_tries = 3 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] num_volume_device_scan_tries = 3 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] nvmeof_conn_info_version = 1 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] nvmet_ns_id = 10 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] nvmet_port_id = 1 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] osapi_max_limit = 1000 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] osapi_volume_ext_list = [] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] osapi_volume_listen_port = 8776 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] osapi_volume_use_ssl = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] osapi_volume_workers = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] per_volume_size_limit = -1 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] periodic_fuzzy_delay = 60 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] periodic_interval = 60 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] public_endpoint = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] publish_errors = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] quota_backup_gigabytes = 1000 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] quota_backups = 10 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] quota_gigabytes = 1000 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] quota_groups = 10 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] quota_snapshots = 10 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] quota_volumes = 10 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] rate_limit_burst = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] rate_limit_except_level = CRITICAL {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] rate_limit_interval = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] reinit_driver_count = 3 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] replication_device = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] report_discard_supported = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] report_interval = 120 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] reservation_clean_interval = 86400 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] reservation_expire = 86400 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] reserved_image_namespaces = [] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] reserved_percentage = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] rpc_response_timeout = 120 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] run_external_periodic_tasks = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] scst_target_driver = iscsi {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] scst_target_iqn_name = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] service_down_time = 720 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] shell_completion = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] snapshot_name_template = snapshot-%s {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] split_loggers = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] state_path = /opt/stack/data/cinder {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] storage_availability_zone = nova {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] storage_protocol = iSCSI {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] syslog_log_facility = LOG_USER {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] target_helper = lioadm {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] target_ip_address = 192.168.122.40 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] target_port = 3260 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] target_protocol = iscsi {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] target_secondary_ip_addresses = [] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] trace_flags = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] transport_url = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] until_refresh = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] use_chap_auth = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] use_default_quota_class = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] use_journal = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] use_json = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] use_multipath_for_image_xfer = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] use_stderr = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] use_syslog = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-159e3873-e652-438e-b635-248525e681c3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87087) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] verify_glance_signatures = enabled {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] volume_api_class = cinder.volume.api.API {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.quobyte [None req-159e3873-e652-438e-b635-248525e681c3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] volume_backend_name = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] volume_clear = zero {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.quobyte [None req-159e3873-e652-438e-b635-248525e681c3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] volume_clear_ionice = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] volume_clear_size = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-159e3873-e652-438e-b635-248525e681c3 None None] Running cmd (subprocess): mount.quobyte {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] volume_copy_bps_limit = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] volume_dd_blocksize = 1M {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] volume_name_template = volume-%s {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] volume_service_inithost_offload = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] volume_usage_audit_period = month {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] zoning_mode = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_concurrency.disable_process_locking = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.auth_section = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.auth_type = password {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.auth_version = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.cache = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.certfile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.include_service_catalog = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.insecure = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.interface = public {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.keyfile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.memcache_password = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.memcache_username = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.region_name = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.service_type = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.40/identity {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.backend = dogpile.cache.null {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.backend_argument = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.backend_expiration_time = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.config_prefix = cache.oslo {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.debug_cache_backend = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.enable_retry_client = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.enable_socket_keepalive = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.enabled = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.expiration_time = 600 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.hashclient_retry_attempts = 2 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.memcache_dead_retry = 300 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.memcache_pool_maxsize = 10 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.memcache_sasl_enabled = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.password = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.proxies = [] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.redis_db = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.redis_server = localhost:6379 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.retry_attempts = 2 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.retry_delay = 0.0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.socket_keepalive_count = 1 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.socket_keepalive_idle = 1 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.socket_keepalive_interval = 1 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.socket_timeout = 1.0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.tls_allowed_ciphers = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.tls_cafile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.tls_certfile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.tls_enabled = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.tls_keyfile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cache.username = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] coordination.backend_url = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.asyncio_connection = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.asyncio_slave_connection = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.backend = sqlalchemy {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.connection = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.connection_debug = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.connection_parameters = {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.connection_recycle_time = 3600 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.connection_trace = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.db_inc_retry_interval = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.db_max_retries = 20 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.db_max_retry_interval = 10 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.db_retry_interval = 1 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.max_overflow = 50 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.max_pool_size = 5 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.max_retries = 10 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.mysql_wsrep_sync_wait = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.pool_timeout = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.retry_interval = 10 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.slave_connection = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.sqlite_synchronous = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.synchronous_reader = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] database.use_db_reconnect = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_tracing.insecure = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] profiler.connection_string = messaging:// {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] profiler.enabled = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] profiler.es_doc_type = notification {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] profiler.es_scroll_size = 10000 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] profiler.es_scroll_time = 2m {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] profiler.filter_error_trace = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] profiler.hmac_keys = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] profiler.sentinel_service_name = mymaster {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] profiler.socket_timeout = 0.1 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] profiler.trace_requests = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack quobyte-client[87088]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] profiler.trace_sqlalchemy = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] profiler_jaeger.process_tags = {} {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack quobyte-client[87088]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] profiler_jaeger.service_name_prefix = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] profiler_otlp.service_name_prefix = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_policy.enforce_new_defaults = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_policy.policy_default_rule = default {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_policy.policy_file = policy.yaml {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-159e3873-e652-438e-b635-248525e681c3 None None] CMD "mount.quobyte" returned: 1 in 0.053s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-159e3873-e652-438e-b635-248525e681c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-159e3873-e652-438e-b635-248525e681c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-159e3873-e652-438e-b635-248525e681c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] privsep_osbrick.group = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] privsep_osbrick.helper_command = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] privsep_osbrick.user = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cinder_sys_admin.group = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cinder_sys_admin.helper_command = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] cinder_sys_admin.user = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] service_user.auth_section = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-159e3873-e652-438e-b635-248525e681c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] service_user.auth_type = password {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-159e3873-e652-438e-b635-248525e681c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] service_user.cafile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] service_user.certfile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-159e3873-e652-438e-b635-248525e681c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] service_user.collect_timing = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] service_user.insecure = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] service_user.keyfile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] service_user.send_service_user_token = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] service_user.split_loggers = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] service_user.timeout = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] service_user.tls_ciphers = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] service_user.tls_min_version = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance.auth_section = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance.auth_type = password {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance.certfile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance.collect_timing = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance.insecure = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance.keyfile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance.region_name = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance.split_loggers = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance.timeout = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance.tls_ciphers = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] glance.tls_min_version = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.backend_availability_zone = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.chap_password = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.chap_username = {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.disk_geometry = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.driver_client_cert = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.driver_client_cert_key = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.driver_data_namespace = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.driver_use_ssl = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.extra_capabilities = {} {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.filter_function = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.goodness_function = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.iscsi_target_flags = {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.iscsi_write_cache = on {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.iser_helper = tgtadm {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.iser_ip_address = 192.168.122.40 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.iser_port = 3260 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.nas_host = {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.nas_login = admin {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.nas_mount_options = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.nas_password = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack sudo[87089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.nas_private_key = {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.nas_share_path = {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.num_shell_tries = 3 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.quobyte_volume_url = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.replication_device = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.report_discard_supported = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.reserved_percentage = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.target_helper = tgtadm {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.target_ip_address = 192.168.122.40 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.target_port = 3260 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.target_protocol = iscsi {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.trace_flags = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.unique_fqdn_network = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.use_chap_auth = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.volume_backend_name = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.volume_clear = zero {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.volume_clear_ionice = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.volume_clear_size = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_reports.file_event_handler = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_reports.log_dir = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.backend_availability_zone = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.backend_host = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.chap_password = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.chap_username = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.chiscsi_conf = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.disk_geometry = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.driver_client_cert = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.driver_data_namespace = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.driver_use_ssl = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.extra_capabilities = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.filter_function = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.goodness_function = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.iser_helper = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:10 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.iser_ip_address = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.iser_port = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.iser_target_prefix = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.nas_host = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.nas_login = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.nas_mount_options = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.nas_password = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.nas_private_key = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.nas_share_path = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.nas_ssh_port = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.num_shell_tries = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.nvmet_port_id = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.replication_device = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.report_discard_supported = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.reserved_percentage = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.scst_target_driver = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.storage_protocol = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.target_helper = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.target_ip_address = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.target_port = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.target_prefix = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.target_protocol = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.trace_flags = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.use_chap_auth = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.volume_clear = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.volume_clear_size = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] QuobyteHD.volumes_dir = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.ssl = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_notifications.driver = [] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_notifications.retry = -1 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] key_manager.fixed_key = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican.barbican_api_version = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican.barbican_endpoint = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican.barbican_endpoint_type = public {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican.barbican_region_name = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican.cafile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican.certfile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican.collect_timing = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican.insecure = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican.keyfile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican.number_of_retries = 60 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican.retry_delay = 1 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican.send_service_user_token = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican.split_loggers = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican.timeout = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican.tls_ciphers = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican.tls_min_version = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican.verify_ssl = True {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican.verify_ssl_path = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican_service_user.auth_section = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican_service_user.auth_type = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican_service_user.cafile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican_service_user.certfile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican_service_user.collect_timing = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican_service_user.insecure = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican_service_user.keyfile = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican_service_user.split_loggers = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican_service_user.timeout = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican_service_user.tls_ciphers = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] barbican_service_user.tls_min_version = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] vault.approle_role_id = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] vault.approle_secret_id = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] vault.auth_method = approle {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] vault.auth_path = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] vault.kv_mountpoint = secret {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] vault.kv_path = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] vault.kv_version = 2 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] vault.namespace = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] vault.root_token_id = **** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] vault.ssl_ca_crt_file = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] vault.timeout = 60.0 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] vault.token_file = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] vault.token_role = None {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] vault.use_ssl = False {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:58:11 devstack cinder-volume[86803]: DEBUG oslo_service.backend._eventlet.service [None req-17fdd055-2de3-4e8f-ad22-f9bc13043e54 None None] ******************************************************************************** {{(pid=86803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 15:58:11 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-159e3873-e652-438e-b635-248525e681c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.268s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:11 devstack cinder-volume[87087]: INFO cinder.volume.driver [None req-159e3873-e652-438e-b635-248525e681c3 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG cinder.volume.driver [None req-159e3873-e652-438e-b635-248525e681c3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1790084838867, 'free_capacity_gb': 1775.1790084838867, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87087) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG oslo_db.sqlalchemy.engines [None req-159e3873-e652-438e-b635-248525e681c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87087) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writer thread running {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG cinder.db.api [None req-159e3873-e652-438e-b635-248525e681c3 None None] Building query based on filter {{(pid=87087) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-159e3873-e652-438e-b635-248525e681c3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87087) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-159e3873-e652-438e-b635-248525e681c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-159e3873-e652-438e-b635-248525e681c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-159e3873-e652-438e-b635-248525e681c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-159e3873-e652-438e-b635-248525e681c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-159e3873-e652-438e-b635-248525e681c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-159e3873-e652-438e-b635-248525e681c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:11 devstack cinder-volume[87087]: INFO cinder.keymgr.migration [None req-b794fdeb-6c23-4a60-9959-077206458654 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 15:58:11 devstack sudo[87092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 15:58:11 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:11 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-159e3873-e652-438e-b635-248525e681c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.232s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-159e3873-e652-438e-b635-248525e681c3 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:58:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-159e3873-e652-438e-b635-248525e681c3 None None] Driver initialization completed successfully. Sep 28 15:58:11 devstack cinder-volume[87087]: INFO cinder.manager [None req-159e3873-e652-438e-b635-248525e681c3 None None] Initiating service 3 cleanup Sep 28 15:58:11 devstack cinder-volume[87087]: INFO cinder.manager [None req-159e3873-e652-438e-b635-248525e681c3 None None] Service 3 cleanup completed. Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG cinder.service [None req-159e3873-e652-438e-b635-248525e681c3 None None] Creating RPC server for service cinder-volume {{(pid=87087) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG cinder.service [None req-159e3873-e652-438e-b635-248525e681c3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87087) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 15:58:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-159e3873-e652-438e-b635-248525e681c3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-159e3873-e652-438e-b635-248525e681c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-159e3873-e652-438e-b635-248525e681c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-159e3873-e652-438e-b635-248525e681c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-159e3873-e652-438e-b635-248525e681c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-159e3873-e652-438e-b635-248525e681c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-159e3873-e652-438e-b635-248525e681c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:11 devstack sudo[87095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 15:58:11 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:11 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-159e3873-e652-438e-b635-248525e681c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.253s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-159e3873-e652-438e-b635-248525e681c3 None None] Driver post RPC initialization completed successfully. Sep 28 15:58:20 devstack cinder-volume[86803]: DEBUG dbcounter [-] [86803] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:58:21 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:58:21 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:58:34 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:58:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 6 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:58:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Flow 'volume_create_manager' (83b8d5ba-c6d7-4f51-ad9e-8454cbfeb96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a254a9-3bc7-457b-9ded-49b0f207b17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a254a9-3bc7-457b-9ded-49b0f207b17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1655791326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e6c889-4238-4303-a831-5f5ffe254096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d751a1e485d7426697f03697e4f7c171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:09Z,use_quota=True,user_id='70ed0ade6fc34c3e928997d945cc2b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db7d26b-a007-4a1f-99b7-b2e54b5b0e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db7d26b-a007-4a1f-99b7-b2e54b5b0e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32dce02e-f0ca-48ae-9503-2d9742904b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32dce02e-f0ca-48ae-9503-2d9742904b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6e6c889-4238-4303-a831-5f5ffe254096', 'volume_name': 'volume-d6e6c889-4238-4303-a831-5f5ffe254096', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11d15bd-748e-420a-8341-86fa348b2841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11d15bd-748e-420a-8341-86fa348b2841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def6bac4-f12e-42ea-be64-4e497b9b41b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:09 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Volume d6e6c889-4238-4303-a831-5f5ffe254096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6e6c889-4238-4303-a831-5f5ffe254096', 'volume_size': 1} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1655791326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e6c889-4238-4303-a831-5f5ffe254096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d751a1e485d7426697f03697e4f7c171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:09Z,use_quota=True,user_id='70ed0ade6fc34c3e928997d945cc2b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Creating volume d6e6c889-4238-4303-a831-5f5ffe254096 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:59:09 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 15:59:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6e6c889-4238-4303-a831-5f5ffe254096 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:09 devstack sudo[87238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6e6c889-4238-4303-a831-5f5ffe254096 1073741824 Sep 28 15:59:09 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:10 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6e6c889-4238-4303-a831-5f5ffe254096 1073741824" returned: 0 in 0.756s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6e6c889-4238-4303-a831-5f5ffe254096 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:10 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6e6c889-4238-4303-a831-5f5ffe254096 Sep 28 15:59:10 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:10 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6e6c889-4238-4303-a831-5f5ffe254096" returned: 0 in 0.373s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:59:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def6bac4-f12e-42ea-be64-4e497b9b41b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6e6c889-4238-4303-a831-5f5ffe254096', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78dac25-4faf-4ca6-ac00-fe4dcb6a5a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:10 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Volume volume-d6e6c889-4238-4303-a831-5f5ffe254096 (d6e6c889-4238-4303-a831-5f5ffe254096): created successfully Sep 28 15:59:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78dac25-4faf-4ca6-ac00-fe4dcb6a5a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Flow 'volume_create_manager' (83b8d5ba-c6d7-4f51-ad9e-8454cbfeb96d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0a95a02e-86a1-4037-9983-b5135f3b9713 tempest-TaggedAttachmentsTest-318403442 None] Created volume successfully. Sep 28 15:59:20 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:59:21 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:59:34 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:59:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:35 devstack sudo[87837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 15:59:35 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:35 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.703s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:59:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:59:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 6 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:59:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Flow 'volume_create_manager' (27065d1d-2a3a-421c-a932-78a36b0f49d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9df8cc3c-f254-4f37-9574-50f164c1155a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9df8cc3c-f254-4f37-9574-50f164c1155a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-890255683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7956ea9-6b29-443b-8ab6-14b60f98856c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a55cb5746a548a2b9f44a52dfb330b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:50Z,use_quota=True,user_id='61d26d13ed6c4c61b5fc5a0ac8c2230d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8cead6-1007-4062-b57f-7d1a6ce9e70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8cead6-1007-4062-b57f-7d1a6ce9e70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5225fe4b-cace-4583-a83d-2adc2f596d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5225fe4b-cace-4583-a83d-2adc2f596d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7956ea9-6b29-443b-8ab6-14b60f98856c', 'volume_name': 'volume-c7956ea9-6b29-443b-8ab6-14b60f98856c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3517ff-ec51-42af-8ffc-288c8cca44dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3517ff-ec51-42af-8ffc-288c8cca44dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531f7217-1d47-445a-ac53-f1b8a17f07dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:49 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Volume c7956ea9-6b29-443b-8ab6-14b60f98856c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7956ea9-6b29-443b-8ab6-14b60f98856c', 'volume_size': 1} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-890255683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7956ea9-6b29-443b-8ab6-14b60f98856c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a55cb5746a548a2b9f44a52dfb330b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:50Z,use_quota=True,user_id='61d26d13ed6c4c61b5fc5a0ac8c2230d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Creating volume c7956ea9-6b29-443b-8ab6-14b60f98856c {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:59:49 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 15:59:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c7956ea9-6b29-443b-8ab6-14b60f98856c 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:50 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c7956ea9-6b29-443b-8ab6-14b60f98856c 1073741824 Sep 28 15:59:50 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:51 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c7956ea9-6b29-443b-8ab6-14b60f98856c 1073741824" returned: 0 in 1.204s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c7956ea9-6b29-443b-8ab6-14b60f98856c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:51 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c7956ea9-6b29-443b-8ab6-14b60f98856c Sep 28 15:59:51 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:51 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c7956ea9-6b29-443b-8ab6-14b60f98856c" returned: 0 in 0.481s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:59:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531f7217-1d47-445a-ac53-f1b8a17f07dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7956ea9-6b29-443b-8ab6-14b60f98856c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e54b89-4f4e-4f06-9285-28017c414356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:51 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Volume volume-c7956ea9-6b29-443b-8ab6-14b60f98856c (c7956ea9-6b29-443b-8ab6-14b60f98856c): created successfully Sep 28 15:59:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e54b89-4f4e-4f06-9285-28017c414356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Flow 'volume_create_manager' (27065d1d-2a3a-421c-a932-78a36b0f49d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:51 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-464d0d15-b81c-4a73-a3da-c6a54e2a03b1 tempest-VolumesAdminNegativeTest-687788158 None] Created volume successfully. Sep 28 15:59:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Acquiring lock "cinder-c7956ea9-6b29-443b-8ab6-14b60f98856c-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Lock "cinder-c7956ea9-6b29-443b-8ab6-14b60f98856c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Acquiring lock "cinder-quobyte-c7956ea9-6b29-443b-8ab6-14b60f98856c" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Lock "cinder-quobyte-c7956ea9-6b29-443b-8ab6-14b60f98856c" acquired by "delete_volume" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:53 devstack cinder-volume[87087]: INFO oslo.privsep.daemon [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_86h6pku/privsep.sock'] Sep 28 15:59:54 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_86h6pku/privsep.sock Sep 28 15:59:54 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:55 devstack cinder-volume[87087]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 15:59:55 devstack cinder-volume[87087]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 15:59:55 devstack cinder-volume[87087]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 15:59:55 devstack cinder-volume[87087]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 15:59:55 devstack cinder-volume[87087]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 15:59:55 devstack cinder-volume[87087]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 15:59:55 devstack cinder-volume[87087]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 15:59:55 devstack cinder-volume[87087]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 15:59:55 devstack cinder-volume[87087]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 15:59:55 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:55 devstack cinder-volume[87087]: INFO oslo.privsep.daemon [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Spawned new privsep daemon via rootwrap Sep 28 15:59:55 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Accepted privsep connection to /tmp/tmp_86h6pku/privsep.sock {{(pid=87087) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 15:59:55 devstack cinder-volume[87087]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 15:59:55 devstack cinder-volume[87087]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 15:59:55 devstack cinder-volume[87087]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 15:59:55 devstack cinder-volume[87087]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88124 Sep 28 15:59:55 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd12e69-ec93-4dac-a840-e0ca14b11b90]: (2,) {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:55 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc7c3e5-735d-403c-b1be-714645b2aad0]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c7956ea9-6b29-443b-8ab6-14b60f98856c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:55 devstack sudo[88127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c7956ea9-6b29-443b-8ab6-14b60f98856c Sep 28 15:59:55 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:56 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c7956ea9-6b29-443b-8ab6-14b60f98856c" returned: 0 in 0.593s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c7956ea9-6b29-443b-8ab6-14b60f98856c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:56 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c7956ea9-6b29-443b-8ab6-14b60f98856c Sep 28 15:59:56 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:56 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c7956ea9-6b29-443b-8ab6-14b60f98856c" returned: 0 in 0.410s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Lock "cinder-quobyte-c7956ea9-6b29-443b-8ab6-14b60f98856c" released by "delete_volume" :: held 2.688s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:59:56 devstack cinder-volume[87087]: WARNING cinder.quota [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:59:56 devstack cinder-volume[87087]: WARNING cinder.quota [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:59:56 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Created reservations ['f20be374-087f-4e98-9957-cee271efdcdd', 'f377d48e-5598-4824-ac8b-92f0d262e0e2', 'd6602659-d63e-4d27-9a1e-863bdd9f03a1', 'd004eb93-4764-47c3-aa84-8389c31ba84f'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:59:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:57 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 15:59:57 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:57 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.456s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:57 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:59:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Deleted volume successfully. Sep 28 15:59:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8ec2773b-aaca-466a-8af9-e01e8b5f025c tempest-VolumesAdminNegativeTest-687788158 None] Lock "cinder-c7956ea9-6b29-443b-8ab6-14b60f98856c-delete_volume" released by "delete_volume" :: held 3.652s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Flow 'volume_create_manager' (24adc2ec-24bd-426c-8cd9-3b80f39c3c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78a642d-dc0f-4b9d-aafb-504344846361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78a642d-dc0f-4b9d-aafb-504344846361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1847909010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc498e5-e189-4183-9864-43ab3615db69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab618d18943a49b49d8c130cc1b33541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:04Z,use_quota=True,user_id='adae624f2a994226a21e5075ea2ac189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081e7e91-ad3a-4ff3-b4e8-56bc8425cb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081e7e91-ad3a-4ff3-b4e8-56bc8425cb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1adef7a3-ba4f-4bde-9e03-10870605369a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1adef7a3-ba4f-4bde-9e03-10870605369a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fc498e5-e189-4183-9864-43ab3615db69', 'volume_name': 'volume-9fc498e5-e189-4183-9864-43ab3615db69', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73a8250-68cd-4c4d-b6f8-498de4ebe317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73a8250-68cd-4c4d-b6f8-498de4ebe317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85b061a-4dde-4b02-addb-2fa037d983ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:04 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Volume 9fc498e5-e189-4183-9864-43ab3615db69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fc498e5-e189-4183-9864-43ab3615db69', 'volume_size': 1} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1847909010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc498e5-e189-4183-9864-43ab3615db69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab618d18943a49b49d8c130cc1b33541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:04Z,use_quota=True,user_id='adae624f2a994226a21e5075ea2ac189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Creating volume 9fc498e5-e189-4183-9864-43ab3615db69 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:00:04 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:00:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9fc498e5-e189-4183-9864-43ab3615db69 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:04 devstack sudo[88217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9fc498e5-e189-4183-9864-43ab3615db69 1073741824 Sep 28 16:00:04 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:05 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9fc498e5-e189-4183-9864-43ab3615db69 1073741824" returned: 0 in 0.590s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9fc498e5-e189-4183-9864-43ab3615db69 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:05 devstack sudo[88223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9fc498e5-e189-4183-9864-43ab3615db69 Sep 28 16:00:05 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:05 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9fc498e5-e189-4183-9864-43ab3615db69" returned: 0 in 0.320s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:00:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85b061a-4dde-4b02-addb-2fa037d983ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fc498e5-e189-4183-9864-43ab3615db69', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002b7018-44b5-4fb1-a32f-15c61626681c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:05 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Volume volume-9fc498e5-e189-4183-9864-43ab3615db69 (9fc498e5-e189-4183-9864-43ab3615db69): created successfully Sep 28 16:00:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002b7018-44b5-4fb1-a32f-15c61626681c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Flow 'volume_create_manager' (24adc2ec-24bd-426c-8cd9-3b80f39c3c62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:05 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-73608237-3014-439b-aed5-6b978f6a4400 tempest-AttachVolumeTestJSON-509626539 None] Created volume successfully. Sep 28 16:00:09 devstack cinder-volume[87087]: WARNING py.warnings [req-4648b4d0-5c5e-4b01-b4e5-d2dfb88aca2b req-7fde3b46-f24b-40ff-9db5-9c58969c7435 tempest-AttachVolumeTestJSON-509626539 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 28 16:00:09 devstack cinder-volume[87087]: .first() Sep 28 16:00:09 devstack cinder-volume[87087]: Sep 28 16:00:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-4648b4d0-5c5e-4b01-b4e5-d2dfb88aca2b req-7fde3b46-f24b-40ff-9db5-9c58969c7435 tempest-AttachVolumeTestJSON-509626539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-4648b4d0-5c5e-4b01-b4e5-d2dfb88aca2b req-7fde3b46-f24b-40ff-9db5-9c58969c7435 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-4648b4d0-5c5e-4b01-b4e5-d2dfb88aca2b req-7fde3b46-f24b-40ff-9db5-9c58969c7435 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-4648b4d0-5c5e-4b01-b4e5-d2dfb88aca2b req-7fde3b46-f24b-40ff-9db5-9c58969c7435 tempest-AttachVolumeTestJSON-509626539 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-9fc498e5-e189-4183-9864-43ab3615db69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2101276a-3cf4-4653-adcd-d4ec43d4a4d4', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:00:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-4648b4d0-5c5e-4b01-b4e5-d2dfb88aca2b req-7fde3b46-f24b-40ff-9db5-9c58969c7435 tempest-AttachVolumeTestJSON-509626539 None] attachment_update completed successfully. Sep 28 16:00:21 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=15,cinder:UPDATE=19,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:00:21 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=13,cinder:SELECT=17,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Flow 'volume_create_manager' (36db6e1d-3586-43df-b201-ac6a82db2728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a519e4-1232-4700-971f-abd4c4db45fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a519e4-1232-4700-971f-abd4c4db45fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2130089638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac6933b-f47d-454a-a5f9-3f3f062bb2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f2848a2c67454aa0f1be2ceab36dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:27Z,use_quota=True,user_id='55efa780c0cf485aa7b4c1d86315dc05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90767451-885d-4764-b0ec-0297320c34ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90767451-885d-4764-b0ec-0297320c34ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ab37e9-7ccf-4050-b5b1-0c15a90c9f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ab37e9-7ccf-4050-b5b1-0c15a90c9f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eac6933b-f47d-454a-a5f9-3f3f062bb2be', 'volume_name': 'volume-eac6933b-f47d-454a-a5f9-3f3f062bb2be', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6378911b-0666-489e-ac2a-03e27ee53e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6378911b-0666-489e-ac2a-03e27ee53e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3538abef-0162-4621-95ec-1cdb5f5dfee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:26 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Volume eac6933b-f47d-454a-a5f9-3f3f062bb2be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eac6933b-f47d-454a-a5f9-3f3f062bb2be', 'volume_size': 1} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2130089638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac6933b-f47d-454a-a5f9-3f3f062bb2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f2848a2c67454aa0f1be2ceab36dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:27Z,use_quota=True,user_id='55efa780c0cf485aa7b4c1d86315dc05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Creating volume eac6933b-f47d-454a-a5f9-3f3f062bb2be {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:00:26 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac6933b-f47d-454a-a5f9-3f3f062bb2be 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:26 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac6933b-f47d-454a-a5f9-3f3f062bb2be 1073741824 Sep 28 16:00:26 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-a85efd11-98de-4784-b1ca-bcaf3682d325 req-f383bd2f-b785-4ce8-a750-47fbaca619f6 tempest-TaggedAttachmentsTest-318403442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:27 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac6933b-f47d-454a-a5f9-3f3f062bb2be 1073741824" returned: 0 in 0.857s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac6933b-f47d-454a-a5f9-3f3f062bb2be {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:27 devstack sudo[89485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac6933b-f47d-454a-a5f9-3f3f062bb2be Sep 28 16:00:27 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:28 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac6933b-f47d-454a-a5f9-3f3f062bb2be" returned: 0 in 0.461s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:00:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-a85efd11-98de-4784-b1ca-bcaf3682d325 req-f383bd2f-b785-4ce8-a750-47fbaca619f6 tempest-TaggedAttachmentsTest-318403442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.244s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3538abef-0162-4621-95ec-1cdb5f5dfee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eac6933b-f47d-454a-a5f9-3f3f062bb2be', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be46de23-2369-46e5-a031-bbb35305fa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:28 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Volume volume-eac6933b-f47d-454a-a5f9-3f3f062bb2be (eac6933b-f47d-454a-a5f9-3f3f062bb2be): created successfully Sep 28 16:00:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be46de23-2369-46e5-a031-bbb35305fa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Flow 'volume_create_manager' (36db6e1d-3586-43df-b201-ac6a82db2728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-a85efd11-98de-4784-b1ca-bcaf3682d325 req-f383bd2f-b785-4ce8-a750-47fbaca619f6 tempest-TaggedAttachmentsTest-318403442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.160s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:28 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7648da0b-9ce6-4385-a79f-57d99c72ce11 tempest-DeleteServersTestJSON-2106222759 None] Created volume successfully. Sep 28 16:00:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-a85efd11-98de-4784-b1ca-bcaf3682d325 req-f383bd2f-b785-4ce8-a750-47fbaca619f6 tempest-TaggedAttachmentsTest-318403442 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-d6e6c889-4238-4303-a831-5f5ffe254096', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bc8c768-b17a-4923-852a-dfe0bf114ec6', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:00:28 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-a85efd11-98de-4784-b1ca-bcaf3682d325 req-f383bd2f-b785-4ce8-a750-47fbaca619f6 tempest-TaggedAttachmentsTest-318403442 None] attachment_update completed successfully. Sep 28 16:00:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-d4f560c0-72ae-472e-99f1-ad9a9f9dffb7 req-2b70a09c-2861-468d-855f-7d947fd3a75b tempest-DeleteServersTestJSON-2106222759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-d4f560c0-72ae-472e-99f1-ad9a9f9dffb7 req-2b70a09c-2861-468d-855f-7d947fd3a75b tempest-DeleteServersTestJSON-2106222759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-d4f560c0-72ae-472e-99f1-ad9a9f9dffb7 req-2b70a09c-2861-468d-855f-7d947fd3a75b tempest-DeleteServersTestJSON-2106222759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-d4f560c0-72ae-472e-99f1-ad9a9f9dffb7 req-2b70a09c-2861-468d-855f-7d947fd3a75b tempest-DeleteServersTestJSON-2106222759 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-eac6933b-f47d-454a-a5f9-3f3f062bb2be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45448633-be3b-4045-ba3e-cc4300f60146', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:00:31 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-d4f560c0-72ae-472e-99f1-ad9a9f9dffb7 req-2b70a09c-2861-468d-855f-7d947fd3a75b tempest-DeleteServersTestJSON-2106222759 None] attachment_update completed successfully. Sep 28 16:00:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-4e5dd653-f7bd-49e0-8844-e931b4ccc6a3 req-dac23bd5-9597-4c0a-a525-2c8f0069ba42 tempest-TaggedAttachmentsTest-318403442 None] Terminate volume connection completed successfully. Sep 28 16:00:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-4e5dd653-f7bd-49e0-8844-e931b4ccc6a3 req-dac23bd5-9597-4c0a-a525-2c8f0069ba42 tempest-TaggedAttachmentsTest-318403442 None] Deleting attachment 6bc8c768-b17a-4923-852a-dfe0bf114ec6. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:00:34 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:00:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:35 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:00:35 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.636s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:00:35 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-cb9dfc1b-1d9b-480e-9bf8-b65856f64e43 req-fcb01049-4745-4ed3-af15-5d93fb7b264d tempest-DeleteServersTestJSON-2106222759 None] Terminate volume connection completed successfully. Sep 28 16:00:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-cb9dfc1b-1d9b-480e-9bf8-b65856f64e43 req-fcb01049-4745-4ed3-af15-5d93fb7b264d tempest-DeleteServersTestJSON-2106222759 None] Deleting attachment 45448633-be3b-4045-ba3e-cc4300f60146. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:00:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] Acquiring lock "cinder-eac6933b-f47d-454a-a5f9-3f3f062bb2be-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] Lock "cinder-eac6933b-f47d-454a-a5f9-3f3f062bb2be-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] Acquiring lock "cinder-quobyte-eac6933b-f47d-454a-a5f9-3f3f062bb2be" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] Lock "cinder-quobyte-eac6933b-f47d-454a-a5f9-3f3f062bb2be" acquired by "delete_volume" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:41 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d66ab4-7dca-4f03-8d0f-b4a13c9a6648]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac6933b-f47d-454a-a5f9-3f3f062bb2be {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:41 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac6933b-f47d-454a-a5f9-3f3f062bb2be Sep 28 16:00:41 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:41 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac6933b-f47d-454a-a5f9-3f3f062bb2be" returned: 0 in 0.579s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac6933b-f47d-454a-a5f9-3f3f062bb2be {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:41 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac6933b-f47d-454a-a5f9-3f3f062bb2be Sep 28 16:00:41 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:42 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac6933b-f47d-454a-a5f9-3f3f062bb2be" returned: 0 in 0.428s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] Lock "cinder-quobyte-eac6933b-f47d-454a-a5f9-3f3f062bb2be" released by "delete_volume" :: held 1.135s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:42 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] Created reservations ['50a6b7df-63a6-40d0-9fd1-060092a4e851', 'c8c5aba7-1568-49b4-a30f-7d92c6ad865f', 'bab985c7-f761-4a49-bbe9-a64fbc98211e', '93e570ec-f616-4cb8-a4f1-2ecefd13d0d1'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:00:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:42 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:00:42 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:42 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.343s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:42 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:00:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] Deleted volume successfully. Sep 28 16:00:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-08f8f09a-b0d7-488e-b473-0718045895fc tempest-DeleteServersTestJSON-2106222759 None] Lock "cinder-eac6933b-f47d-454a-a5f9-3f3f062bb2be-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:52 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=19,cinder:INSERT=3,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:00:52 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=16,cinder:SELECT=25,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:00:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] Acquiring lock "cinder-d6e6c889-4238-4303-a831-5f5ffe254096-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] Lock "cinder-d6e6c889-4238-4303-a831-5f5ffe254096-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] Acquiring lock "cinder-quobyte-d6e6c889-4238-4303-a831-5f5ffe254096" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] Lock "cinder-quobyte-d6e6c889-4238-4303-a831-5f5ffe254096" acquired by "delete_volume" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:53 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fa3aa5-2056-416b-adc7-78703a399979]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6e6c889-4238-4303-a831-5f5ffe254096 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:53 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6e6c889-4238-4303-a831-5f5ffe254096 Sep 28 16:00:53 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:53 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6e6c889-4238-4303-a831-5f5ffe254096" returned: 0 in 0.540s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6e6c889-4238-4303-a831-5f5ffe254096 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:53 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6e6c889-4238-4303-a831-5f5ffe254096 Sep 28 16:00:53 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:54 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6e6c889-4238-4303-a831-5f5ffe254096" returned: 0 in 0.449s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] Lock "cinder-quobyte-d6e6c889-4238-4303-a831-5f5ffe254096" released by "delete_volume" :: held 1.116s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:54 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] Created reservations ['aef9dff3-ee9c-446b-87e2-367950cdf6c5', 'ceb76838-160e-4dfa-8877-309ac2ac49d2', '6ca57dba-7845-4950-817f-1fa425e030bb', 'bdafbae4-cd4d-483a-8603-da8d0cdbd809'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:00:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:54 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:00:54 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:54 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.317s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:54 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:00:54 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] Deleted volume successfully. Sep 28 16:00:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-99b4d79d-9c3e-4857-a996-90bc773f161e tempest-TaggedAttachmentsTest-318403442 None] Lock "cinder-d6e6c889-4238-4303-a831-5f5ffe254096-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e1fff2ad-2063-429d-b61e-a08944644883 tempest-GroupSnapshotsV319Test-2126485812 None] Group tempest-GroupSnapshotsV319Test-Group-1416362231: creating Sep 28 16:01:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e1fff2ad-2063-429d-b61e-a08944644883 tempest-GroupSnapshotsV319Test-2126485812 None] Group tempest-GroupSnapshotsV319Test-Group-1416362231: created successfully Sep 28 16:01:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e1fff2ad-2063-429d-b61e-a08944644883 tempest-GroupSnapshotsV319Test-2126485812 None] Create group completed successfully. Sep 28 16:01:05 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:01:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Flow 'volume_create_manager' (4701d909-06bf-43a0-9b7a-00009d6a7a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:01:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d82bc9a-764e-4766-a275-f95cef3e191c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d82bc9a-764e-4766-a275-f95cef3e191c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1846189116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bfe8c25e-f2c4-428c-af74-2ea7c1645204,host='devstack@QuobyteHD#QuobyteHD',id=874c5974-a0aa-493b-b7e2-c66aa57a7406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1103a52f30842c4b3bdb4842e85afb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:01:06Z,use_quota=True,user_id='247a3209fc7244dea2c5ece10d0c071a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26888b23-a639-4329-8143-60b843542a22),volume_type_id=26888b23-a639-4329-8143-60b843542a22)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbde5964-ecdc-4714-972c-cd1d62a1ce42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbde5964-ecdc-4714-972c-cd1d62a1ce42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc12bae-79cb-4e08-8182-a0af94a43fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc12bae-79cb-4e08-8182-a0af94a43fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '874c5974-a0aa-493b-b7e2-c66aa57a7406', 'volume_name': 'volume-874c5974-a0aa-493b-b7e2-c66aa57a7406', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c755458-ca6b-4255-99ea-dd2041b9f036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c755458-ca6b-4255-99ea-dd2041b9f036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e772fb90-ffda-4ed1-aa98-16296ecf4cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:05 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Volume 874c5974-a0aa-493b-b7e2-c66aa57a7406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-874c5974-a0aa-493b-b7e2-c66aa57a7406', 'volume_size': 1} Sep 28 16:01:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bfe8c25e-f2c4-428c-af74-2ea7c1645204,created_at=2026-09-28T14:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1846189116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bfe8c25e-f2c4-428c-af74-2ea7c1645204,host='devstack@QuobyteHD#QuobyteHD',id=874c5974-a0aa-493b-b7e2-c66aa57a7406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1103a52f30842c4b3bdb4842e85afb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:01:06Z,use_quota=True,user_id='247a3209fc7244dea2c5ece10d0c071a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26888b23-a639-4329-8143-60b843542a22),volume_type_id=26888b23-a639-4329-8143-60b843542a22)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:01:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Creating volume 874c5974-a0aa-493b-b7e2-c66aa57a7406 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:01:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:01:06 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:01:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:06 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406 1073741824 Sep 28 16:01:06 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:06 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406 1073741824" returned: 0 in 0.765s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:06 devstack sudo[89816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406 Sep 28 16:01:06 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:07 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406" returned: 0 in 0.360s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:01:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e772fb90-ffda-4ed1-aa98-16296ecf4cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-874c5974-a0aa-493b-b7e2-c66aa57a7406', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb2f254-14b9-4d06-9cb6-e26a5d14120d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:07 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Volume volume-874c5974-a0aa-493b-b7e2-c66aa57a7406 (874c5974-a0aa-493b-b7e2-c66aa57a7406): created successfully Sep 28 16:01:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb2f254-14b9-4d06-9cb6-e26a5d14120d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Flow 'volume_create_manager' (4701d909-06bf-43a0-9b7a-00009d6a7a96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:01:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a8fa6fc3-f2f0-46cc-9892-c5e945e48d3d tempest-GroupSnapshotsV319Test-2126485812 None] Created volume successfully. Sep 28 16:01:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-5c470b11-86af-482c-9dc3-768d0eb525c7 req-23020f2d-4448-468a-bfa7-cbb4af81a9e7 tempest-AttachVolumeTestJSON-509626539 None] Terminate volume connection completed successfully. Sep 28 16:01:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-5c470b11-86af-482c-9dc3-768d0eb525c7 req-23020f2d-4448-468a-bfa7-cbb4af81a9e7 tempest-AttachVolumeTestJSON-509626539 None] Deleting attachment 2101276a-3cf4-4653-adcd-d4ec43d4a4d4. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:01:09 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] GroupSnapshot be52c9c6-2993-4257-9c11-c523c6eaf82b: creating. Sep 28 16:01:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] Group snapshot be52c9c6-2993-4257-9c11-c523c6eaf82b: creating. {{(pid=87087) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 16:01:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] Creating offline snapshot 3e852461-7972-4f72-a21d-fc30a597898d of volume 874c5974-a0aa-493b-b7e2-c66aa57a7406 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:01:09 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3537ec33-0390-4a4d-9d36-c13b9bd2dcca]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:09 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406 Sep 28 16:01:09 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:10 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406" returned: 0 in 0.529s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:10 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d 1G Sep 28 16:01:10 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:10 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d 1G" returned: 0 in 0.647s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874c5974-a0aa-493b-b7e2-c66aa57a7406 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:10 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874c5974-a0aa-493b-b7e2-c66aa57a7406 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d Sep 28 16:01:10 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:11 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874c5974-a0aa-493b-b7e2-c66aa57a7406 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d" returned: 0 in 0.549s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:11 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:01:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:11 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d Sep 28 16:01:11 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:11 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d" returned: 0 in 0.288s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:11 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.info Sep 28 16:01:11 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:11 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.info" returned: 0 in 0.343s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:11 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:01:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:12 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.info Sep 28 16:01:12 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:12 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.info" returned: 0 in 0.880s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.400s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:13 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c932adfe-61df-47f9-b455-0cbf29054f6d tempest-GroupSnapshotsV319Test-2126485812 None] group_snapshot be52c9c6-2993-4257-9c11-c523c6eaf82b: created successfully Sep 28 16:01:15 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] group_snapshot be52c9c6-2993-4257-9c11-c523c6eaf82b: deleting Sep 28 16:01:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] group_snapshot be52c9c6-2993-4257-9c11-c523c6eaf82b: deleting {{(pid=87087) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 16:01:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] Acquiring lock "cinder-quobyte-874c5974-a0aa-493b-b7e2-c66aa57a7406" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] Lock "cinder-quobyte-874c5974-a0aa-493b-b7e2-c66aa57a7406" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] Acquiring lock "cinder-quobyte-3e852461-7972-4f72-a21d-fc30a597898d" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] Lock "cinder-quobyte-3e852461-7972-4f72-a21d-fc30a597898d" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] Deleting offline snapshot 3e852461-7972-4f72-a21d-fc30a597898d of volume 874c5974-a0aa-493b-b7e2-c66aa57a7406 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:01:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] snapshot_file for this snap is: volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:01:15 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd3f008-bf07-4323-9b97-a57f90fcd5a4]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:15 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d Sep 28 16:01:15 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:16 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d" returned: 0 in 0.627s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-874c5974-a0aa-493b-b7e2-c66aa57a7406(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:01:16 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c819f101-2e62-4e21-9726-3f002e245c04]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:16 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406 Sep 28 16:01:16 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:16 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406" returned: 0 in 0.613s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:16 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d Sep 28 16:01:16 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:17 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d" returned: 0 in 0.633s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:17 devstack sudo[90071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d Sep 28 16:01:17 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:17 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406.3e852461-7972-4f72-a21d-fc30a597898d" returned: 0 in 0.296s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] Lock "cinder-quobyte-3e852461-7972-4f72-a21d-fc30a597898d" released by "_delete_snapshot" :: held 2.394s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] Lock "cinder-quobyte-874c5974-a0aa-493b-b7e2-c66aa57a7406" released by "delete_snapshot" :: held 2.451s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:17 devstack cinder-volume[87087]: WARNING cinder.quota [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1283761193 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1283761193, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:01:17 devstack cinder-volume[87087]: WARNING cinder.quota [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1283761193 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1283761193, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:01:17 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] Created reservations ['749b1b10-7458-4707-92ca-4615ff248a7c', '4e7d7ed5-2757-4c45-abcb-84fba6db3a3a', 'e63bcb43-a559-47c6-a541-126d8dca5775', '7b30039a-930c-4919-ac0f-c61aa5fdf401'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:01:18 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c47cce0a-55c5-48e3-be5d-bef315f5d515 tempest-GroupSnapshotsV319Test-2126485812 None] group_snapshot be52c9c6-2993-4257-9c11-c523c6eaf82b: deleted successfully Sep 28 16:01:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-06d621bc-32e1-4e70-9589-f752bd4f9d6a tempest-GroupSnapshotsV319Test-2126485812 None] Acquiring lock "cinder-quobyte-874c5974-a0aa-493b-b7e2-c66aa57a7406" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-06d621bc-32e1-4e70-9589-f752bd4f9d6a tempest-GroupSnapshotsV319Test-2126485812 None] Lock "cinder-quobyte-874c5974-a0aa-493b-b7e2-c66aa57a7406" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:19 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed52d5d-4072-4b3b-886f-4032449f9ea6]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06d621bc-32e1-4e70-9589-f752bd4f9d6a tempest-GroupSnapshotsV319Test-2126485812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:19 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406 Sep 28 16:01:19 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:19 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06d621bc-32e1-4e70-9589-f752bd4f9d6a tempest-GroupSnapshotsV319Test-2126485812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406" returned: 0 in 0.473s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06d621bc-32e1-4e70-9589-f752bd4f9d6a tempest-GroupSnapshotsV319Test-2126485812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:19 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406 Sep 28 16:01:19 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:20 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06d621bc-32e1-4e70-9589-f752bd4f9d6a tempest-GroupSnapshotsV319Test-2126485812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-874c5974-a0aa-493b-b7e2-c66aa57a7406" returned: 0 in 0.293s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-06d621bc-32e1-4e70-9589-f752bd4f9d6a tempest-GroupSnapshotsV319Test-2126485812 None] Lock "cinder-quobyte-874c5974-a0aa-493b-b7e2-c66aa57a7406" released by "delete_volume" :: held 0.855s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:20 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-06d621bc-32e1-4e70-9589-f752bd4f9d6a tempest-GroupSnapshotsV319Test-2126485812 None] Created reservations ['bd43750d-96db-4a57-9923-86ab9242369a'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:01:20 devstack cinder-volume[87087]: WARNING cinder.quota [None req-06d621bc-32e1-4e70-9589-f752bd4f9d6a tempest-GroupSnapshotsV319Test-2126485812 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1283761193 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1283761193, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:01:20 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-06d621bc-32e1-4e70-9589-f752bd4f9d6a tempest-GroupSnapshotsV319Test-2126485812 None] Created reservations ['35a313b1-6648-444e-9983-337b7e1fdacd', '452604d5-6246-4957-816d-7e6f520d9565', 'cde7ac21-08e5-4cdb-a08f-4b9c03859f3d', '74ad94ff-f061-43b3-9b90-fc9d30e4bfaf'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:01:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-06d621bc-32e1-4e70-9589-f752bd4f9d6a tempest-GroupSnapshotsV319Test-2126485812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-06d621bc-32e1-4e70-9589-f752bd4f9d6a tempest-GroupSnapshotsV319Test-2126485812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-06d621bc-32e1-4e70-9589-f752bd4f9d6a tempest-GroupSnapshotsV319Test-2126485812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-06d621bc-32e1-4e70-9589-f752bd4f9d6a tempest-GroupSnapshotsV319Test-2126485812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-06d621bc-32e1-4e70-9589-f752bd4f9d6a tempest-GroupSnapshotsV319Test-2126485812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06d621bc-32e1-4e70-9589-f752bd4f9d6a tempest-GroupSnapshotsV319Test-2126485812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:20 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:01:20 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:20 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06d621bc-32e1-4e70-9589-f752bd4f9d6a tempest-GroupSnapshotsV319Test-2126485812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.326s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:20 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-06d621bc-32e1-4e70-9589-f752bd4f9d6a tempest-GroupSnapshotsV319Test-2126485812 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:01:20 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-06d621bc-32e1-4e70-9589-f752bd4f9d6a tempest-GroupSnapshotsV319Test-2126485812 None] Delete group completed successfully. Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Flow 'volume_create_manager' (f92a73b9-3e88-4cac-aca0-7d1632fc94fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72285c3-5f5b-45c1-b205-d0bcec1fb335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72285c3-5f5b-45c1-b205-d0bcec1fb335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-39862933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b03d4c-1cd5-4ca3-8095-8af0934fa311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f977af7f57142feb4f0f88ebbddd02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:01:29Z,use_quota=True,user_id='1d4014feb3614e97b48ee8ff5f1544d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3865ea-6509-4586-abee-b97e8fe9dca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3865ea-6509-4586-abee-b97e8fe9dca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229bb2c9-c748-442d-a791-76c325cb32ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229bb2c9-c748-442d-a791-76c325cb32ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14b03d4c-1cd5-4ca3-8095-8af0934fa311', 'volume_name': 'volume-14b03d4c-1cd5-4ca3-8095-8af0934fa311', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547a29a3-59ee-4e4b-98e9-cb03de43616a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547a29a3-59ee-4e4b-98e9-cb03de43616a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca56529e-5c1a-4a3d-a117-1151f0d7cfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:29 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Volume 14b03d4c-1cd5-4ca3-8095-8af0934fa311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14b03d4c-1cd5-4ca3-8095-8af0934fa311', 'volume_size': 1} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-39862933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b03d4c-1cd5-4ca3-8095-8af0934fa311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f977af7f57142feb4f0f88ebbddd02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:01:29Z,use_quota=True,user_id='1d4014feb3614e97b48ee8ff5f1544d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Creating volume 14b03d4c-1cd5-4ca3-8095-8af0934fa311 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:01:29 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:01:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-14b03d4c-1cd5-4ca3-8095-8af0934fa311 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:29 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-14b03d4c-1cd5-4ca3-8095-8af0934fa311 1073741824 Sep 28 16:01:29 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:30 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-14b03d4c-1cd5-4ca3-8095-8af0934fa311 1073741824" returned: 0 in 1.061s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-14b03d4c-1cd5-4ca3-8095-8af0934fa311 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:30 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-14b03d4c-1cd5-4ca3-8095-8af0934fa311 Sep 28 16:01:30 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:30 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-14b03d4c-1cd5-4ca3-8095-8af0934fa311" returned: 0 in 0.358s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:01:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca56529e-5c1a-4a3d-a117-1151f0d7cfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14b03d4c-1cd5-4ca3-8095-8af0934fa311', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa26d9b5-a3b7-408a-b940-3701a64394f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:31 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Volume volume-14b03d4c-1cd5-4ca3-8095-8af0934fa311 (14b03d4c-1cd5-4ca3-8095-8af0934fa311): created successfully Sep 28 16:01:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa26d9b5-a3b7-408a-b940-3701a64394f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Flow 'volume_create_manager' (f92a73b9-3e88-4cac-aca0-7d1632fc94fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:01:31 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ba114a6e-e103-43a1-bad4-8ac0a73038f8 tempest-ServerActionsTestOtherA-1617816428 None] Created volume successfully. Sep 28 16:01:34 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-56cd97de-0fe4-4615-8029-ca990b736d2f tempest-GroupsV320Test-1320333096 None] Group tempest-GroupsV320Test-Group-2098922708: creating Sep 28 16:01:34 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-56cd97de-0fe4-4615-8029-ca990b736d2f tempest-GroupsV320Test-1320333096 None] Group tempest-GroupsV320Test-Group-2098922708: created successfully Sep 28 16:01:34 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-56cd97de-0fe4-4615-8029-ca990b736d2f tempest-GroupsV320Test-1320333096 None] Create group completed successfully. Sep 28 16:01:34 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:01:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:35 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:01:35 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:35 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.345s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:01:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:01:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 8 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:01:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:01:36 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-dd69bffa-b9b8-4d22-b118-a480dde8a5ea tempest-GroupsV320Test-1320333096 None] Created reservations ['f3a5c0b0-39b9-4660-8d2a-8cd8e6211d16'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:01:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dd69bffa-b9b8-4d22-b118-a480dde8a5ea tempest-GroupsV320Test-1320333096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dd69bffa-b9b8-4d22-b118-a480dde8a5ea tempest-GroupsV320Test-1320333096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dd69bffa-b9b8-4d22-b118-a480dde8a5ea tempest-GroupsV320Test-1320333096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dd69bffa-b9b8-4d22-b118-a480dde8a5ea tempest-GroupsV320Test-1320333096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dd69bffa-b9b8-4d22-b118-a480dde8a5ea tempest-GroupsV320Test-1320333096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd69bffa-b9b8-4d22-b118-a480dde8a5ea tempest-GroupsV320Test-1320333096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:37 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:01:37 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:37 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd69bffa-b9b8-4d22-b118-a480dde8a5ea tempest-GroupsV320Test-1320333096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.478s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:37 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dd69bffa-b9b8-4d22-b118-a480dde8a5ea tempest-GroupsV320Test-1320333096 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:01:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-dd69bffa-b9b8-4d22-b118-a480dde8a5ea tempest-GroupsV320Test-1320333096 None] Delete group completed successfully. Sep 28 16:01:47 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=34,cinder:INSERT=10,cinder:UPDATE=37 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:01:47 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=38,cinder:SELECT=44,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Flow 'volume_create_manager' (bc79ff62-9462-4827-81e2-b342d3637422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb3bbef-fa77-4141-bd88-d25f98798412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb3bbef-fa77-4141-bd88-d25f98798412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-182831140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb7e57a-ad5a-4b90-bd1c-059fc4172c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dc1d56f192f4086a0525d6ab9cd86a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:10Z,use_quota=True,user_id='b3e163327ff44d3ea7c3c1221460312b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f982fa-0db8-423f-8611-b51b3e796fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f982fa-0db8-423f-8611-b51b3e796fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163f3402-0c72-4c1f-9b47-4677268647c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163f3402-0c72-4c1f-9b47-4677268647c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb7e57a-ad5a-4b90-bd1c-059fc4172c5b', 'volume_name': 'volume-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccb1e016-f6ac-4c5c-989a-48b6da1dd990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccb1e016-f6ac-4c5c-989a-48b6da1dd990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571174e4-fdb1-4b47-ad7a-4e25a4ab959c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:10 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Volume deb7e57a-ad5a-4b90-bd1c-059fc4172c5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b', 'volume_size': 1} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-182831140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb7e57a-ad5a-4b90-bd1c-059fc4172c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dc1d56f192f4086a0525d6ab9cd86a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:10Z,use_quota=True,user_id='b3e163327ff44d3ea7c3c1221460312b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Creating volume deb7e57a-ad5a-4b90-bd1c-059fc4172c5b {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:02:10 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:02:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:10 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b 1073741824 Sep 28 16:02:10 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:11 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b 1073741824" returned: 0 in 0.869s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:11 devstack sudo[90700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b Sep 28 16:02:11 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:11 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b" returned: 0 in 0.318s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:02:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571174e4-fdb1-4b47-ad7a-4e25a4ab959c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd896423-7ba4-4f8a-8fa6-9107f872493f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:11 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Volume volume-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b (deb7e57a-ad5a-4b90-bd1c-059fc4172c5b): created successfully Sep 28 16:02:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd896423-7ba4-4f8a-8fa6-9107f872493f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Flow 'volume_create_manager' (bc79ff62-9462-4827-81e2-b342d3637422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7ae7d61f-1769-4be6-a315-210d035184fd tempest-ServersNegativeTestJSON-357227773 None] Created volume successfully. Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-f471b08a-fbb9-439e-97e6-9ec1e50a0b9c req-7b772642-ca09-4567-a624-90d52593074c tempest-ServerActionsTestOtherA-1617816428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-f471b08a-fbb9-439e-97e6-9ec1e50a0b9c req-7b772642-ca09-4567-a624-90d52593074c tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-f471b08a-fbb9-439e-97e6-9ec1e50a0b9c req-7b772642-ca09-4567-a624-90d52593074c tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-f471b08a-fbb9-439e-97e6-9ec1e50a0b9c req-7b772642-ca09-4567-a624-90d52593074c tempest-ServerActionsTestOtherA-1617816428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-14b03d4c-1cd5-4ca3-8095-8af0934fa311', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52db8d9b-a3ab-4333-8106-5fbd1d9ae6d8', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:02:15 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-f471b08a-fbb9-439e-97e6-9ec1e50a0b9c req-7b772642-ca09-4567-a624-90d52593074c tempest-ServerActionsTestOtherA-1617816428 None] attachment_update completed successfully. Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Flow 'volume_create_manager' (2cc9502b-f126-41ea-84a2-ace06335a2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2cf004-fad2-48ed-a0e2-f3a6d4dcd6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2cf004-fad2-48ed-a0e2-f3a6d4dcd6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-430952475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb6a28b8-865e-4844-83e9-009eb20fe516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dc1d56f192f4086a0525d6ab9cd86a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:15Z,use_quota=True,user_id='b3e163327ff44d3ea7c3c1221460312b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02bf1f49-8c18-4eba-b127-17fa50da6b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02bf1f49-8c18-4eba-b127-17fa50da6b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec49c82f-3440-4cd6-95e6-137b0a888bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec49c82f-3440-4cd6-95e6-137b0a888bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb6a28b8-865e-4844-83e9-009eb20fe516', 'volume_name': 'volume-eb6a28b8-865e-4844-83e9-009eb20fe516', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c87cf0e-052d-4e92-94bb-87a431a5a56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c87cf0e-052d-4e92-94bb-87a431a5a56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d9b38f-2824-4bce-909f-dd87eb071741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:15 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Volume eb6a28b8-865e-4844-83e9-009eb20fe516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb6a28b8-865e-4844-83e9-009eb20fe516', 'volume_size': 1} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-430952475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb6a28b8-865e-4844-83e9-009eb20fe516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dc1d56f192f4086a0525d6ab9cd86a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:15Z,use_quota=True,user_id='b3e163327ff44d3ea7c3c1221460312b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Creating volume eb6a28b8-865e-4844-83e9-009eb20fe516 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:02:15 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:02:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb6a28b8-865e-4844-83e9-009eb20fe516 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:15 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb6a28b8-865e-4844-83e9-009eb20fe516 1073741824 Sep 28 16:02:15 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:16 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb6a28b8-865e-4844-83e9-009eb20fe516 1073741824" returned: 0 in 0.671s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb6a28b8-865e-4844-83e9-009eb20fe516 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:16 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb6a28b8-865e-4844-83e9-009eb20fe516 Sep 28 16:02:16 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:16 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb6a28b8-865e-4844-83e9-009eb20fe516" returned: 0 in 0.393s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:02:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d9b38f-2824-4bce-909f-dd87eb071741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb6a28b8-865e-4844-83e9-009eb20fe516', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d748eb6b-631d-4bca-83e4-723ad2df00e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:16 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Volume volume-eb6a28b8-865e-4844-83e9-009eb20fe516 (eb6a28b8-865e-4844-83e9-009eb20fe516): created successfully Sep 28 16:02:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d748eb6b-631d-4bca-83e4-723ad2df00e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Flow 'volume_create_manager' (2cc9502b-f126-41ea-84a2-ace06335a2f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:16 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5cbc6b10-11ee-4881-95ab-dc79a73c91b4 tempest-ServersNegativeTestJSON-357227773 None] Created volume successfully. Sep 28 16:02:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] Acquiring lock "cinder-eb6a28b8-865e-4844-83e9-009eb20fe516-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] Lock "cinder-eb6a28b8-865e-4844-83e9-009eb20fe516-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] Acquiring lock "cinder-quobyte-eb6a28b8-865e-4844-83e9-009eb20fe516" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] Lock "cinder-quobyte-eb6a28b8-865e-4844-83e9-009eb20fe516" acquired by "delete_volume" :: waited 0.047s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:18 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e29e3a-9b3f-4395-b3cc-d266da7ba0ca]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb6a28b8-865e-4844-83e9-009eb20fe516 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:18 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb6a28b8-865e-4844-83e9-009eb20fe516 Sep 28 16:02:18 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:18 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb6a28b8-865e-4844-83e9-009eb20fe516" returned: 0 in 0.576s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb6a28b8-865e-4844-83e9-009eb20fe516 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:18 devstack sudo[91161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb6a28b8-865e-4844-83e9-009eb20fe516 Sep 28 16:02:18 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:19 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb6a28b8-865e-4844-83e9-009eb20fe516" returned: 0 in 0.349s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] Lock "cinder-quobyte-eb6a28b8-865e-4844-83e9-009eb20fe516" released by "delete_volume" :: held 1.013s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:19 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] Created reservations ['917886ec-3003-41bd-941b-a5b386bfdddd', 'fae59b41-4780-4f4a-a757-59431255da05', 'ddf213f7-7861-4a97-8ccd-d73cc5928c70', 'c3628448-891d-473d-af4f-1d922bb8b8ac'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:02:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-21743d1e-0d30-4fd6-92ec-077cb23df66c req-eb7e0618-489d-401e-94e1-f29925e34a7f tempest-ServerActionsTestOtherA-1617816428 None] Terminate volume connection completed successfully. Sep 28 16:02:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-21743d1e-0d30-4fd6-92ec-077cb23df66c req-eb7e0618-489d-401e-94e1-f29925e34a7f tempest-ServerActionsTestOtherA-1617816428 None] Deleting attachment 52db8d9b-a3ab-4333-8106-5fbd1d9ae6d8. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:02:19 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:02:19 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:20 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.663s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:20 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:02:20 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] Deleted volume successfully. Sep 28 16:02:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef3c38c8-d98d-4741-83a7-2f71c3f3f8a1 tempest-ServersNegativeTestJSON-357227773 None] Lock "cinder-eb6a28b8-865e-4844-83e9-009eb20fe516-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] Acquiring lock "cinder-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] Lock "cinder-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] Acquiring lock "cinder-quobyte-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] Lock "cinder-quobyte-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b" acquired by "delete_volume" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[85aeb213-5f8e-4b9e-aac7-bbd1d544aa7a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:21 devstack sudo[91225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b Sep 28 16:02:21 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-21743d1e-0d30-4fd6-92ec-077cb23df66c req-8dd00c8c-f644-4435-9bf9-53f15f59eed9 tempest-ServerActionsTestOtherA-1617816428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-21743d1e-0d30-4fd6-92ec-077cb23df66c req-8dd00c8c-f644-4435-9bf9-53f15f59eed9 tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-21743d1e-0d30-4fd6-92ec-077cb23df66c req-8dd00c8c-f644-4435-9bf9-53f15f59eed9 tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-21743d1e-0d30-4fd6-92ec-077cb23df66c req-8dd00c8c-f644-4435-9bf9-53f15f59eed9 tempest-ServerActionsTestOtherA-1617816428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-14b03d4c-1cd5-4ca3-8095-8af0934fa311', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bf959c7-6b5b-42b0-8bca-fa26562ef7da', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:02:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-21743d1e-0d30-4fd6-92ec-077cb23df66c req-8dd00c8c-f644-4435-9bf9-53f15f59eed9 tempest-ServerActionsTestOtherA-1617816428 None] attachment_update completed successfully. Sep 28 16:02:21 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b" returned: 0 in 0.955s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:21 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b Sep 28 16:02:21 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:22 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b" returned: 0 in 0.362s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] Lock "cinder-quobyte-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b" released by "delete_volume" :: held 1.429s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:22 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] Created reservations ['7e027342-e5a1-4b6e-b3d0-3e0acd671272', '37422ed4-0263-4303-af8d-21e3135a3442', 'db8514ae-6cd2-46f7-8546-043bcb8dffa7', '3ecdd8d4-7662-4fc2-bd8a-1f34d075dac9'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:02:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:22 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:02:22 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:22 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.332s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:22 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:02:22 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] Deleted volume successfully. Sep 28 16:02:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b5676e53-eb07-4cf7-9000-688e8884ebda tempest-ServersNegativeTestJSON-357227773 None] Lock "cinder-deb7e57a-ad5a-4b90-bd1c-059fc4172c5b-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:31 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:02:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Flow 'volume_create_manager' (2eff15c9-4647-4a28-8db3-fe12a4ac6281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc8698b-8a8f-48f9-9470-324e460677e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc8698b-8a8f-48f9-9470-324e460677e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1163488468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e70cfeff-502e-44fa-a0db-85f61f757619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3022fc4edf4767817c4eda0c3b00cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:32Z,use_quota=True,user_id='caf1714dffed4e84b295f819021aa236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b91e35-98bc-47bc-a0f4-0770b9758ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b91e35-98bc-47bc-a0f4-0770b9758ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea559ee-3437-4783-b3b9-c56685de622f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea559ee-3437-4783-b3b9-c56685de622f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e70cfeff-502e-44fa-a0db-85f61f757619', 'volume_name': 'volume-e70cfeff-502e-44fa-a0db-85f61f757619', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a134f778-2ab9-449a-b1ef-4fa331872849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a134f778-2ab9-449a-b1ef-4fa331872849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d816e8e5-1bcc-42f2-8efd-588630c37130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:32 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Volume e70cfeff-502e-44fa-a0db-85f61f757619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e70cfeff-502e-44fa-a0db-85f61f757619', 'volume_size': 1} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1163488468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e70cfeff-502e-44fa-a0db-85f61f757619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3022fc4edf4767817c4eda0c3b00cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:32Z,use_quota=True,user_id='caf1714dffed4e84b295f819021aa236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Creating volume e70cfeff-502e-44fa-a0db-85f61f757619 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:02:32 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e70cfeff-502e-44fa-a0db-85f61f757619 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:32 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e70cfeff-502e-44fa-a0db-85f61f757619 1073741824 Sep 28 16:02:32 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:32 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e70cfeff-502e-44fa-a0db-85f61f757619 1073741824" returned: 0 in 0.549s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e70cfeff-502e-44fa-a0db-85f61f757619 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:32 devstack sudo[91788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e70cfeff-502e-44fa-a0db-85f61f757619 Sep 28 16:02:32 devstack sudo[91788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:32 devstack sudo[91788]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e70cfeff-502e-44fa-a0db-85f61f757619" returned: 0 in 0.312s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d816e8e5-1bcc-42f2-8efd-588630c37130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e70cfeff-502e-44fa-a0db-85f61f757619', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4e6c60-f7b2-4a1b-a47c-3d0d5e4f279a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:33 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Volume volume-e70cfeff-502e-44fa-a0db-85f61f757619 (e70cfeff-502e-44fa-a0db-85f61f757619): created successfully Sep 28 16:02:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4e6c60-f7b2-4a1b-a47c-3d0d5e4f279a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Flow 'volume_create_manager' (2eff15c9-4647-4a28-8db3-fe12a4ac6281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a3af3aec-293a-44b5-9f00-bd1b0f928a05 tempest-VolumesListAdminTestJSON-1229398533 None] Created volume successfully. Sep 28 16:02:33 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:02:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Flow 'volume_create_manager' (5f15d12b-b216-4b45-b37d-67898f111e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840cde73-b233-4adf-8631-3bf922f8b2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840cde73-b233-4adf-8631-3bf922f8b2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1920771351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f36115f-2782-4510-81da-36924cf59c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab618d18943a49b49d8c130cc1b33541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:34Z,use_quota=True,user_id='adae624f2a994226a21e5075ea2ac189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64b4089-5a77-49c8-967d-d06ec97147ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64b4089-5a77-49c8-967d-d06ec97147ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e71fa1-5ffa-4a4a-999e-b991a9d5d6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e71fa1-5ffa-4a4a-999e-b991a9d5d6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f36115f-2782-4510-81da-36924cf59c2e', 'volume_name': 'volume-9f36115f-2782-4510-81da-36924cf59c2e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a147e30-958c-4686-bc8a-b8f5f0f273d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a147e30-958c-4686-bc8a-b8f5f0f273d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe62b36c-fbda-436d-8aaa-19376376ccb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:34 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Volume 9f36115f-2782-4510-81da-36924cf59c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f36115f-2782-4510-81da-36924cf59c2e', 'volume_size': 1} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1920771351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f36115f-2782-4510-81da-36924cf59c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab618d18943a49b49d8c130cc1b33541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:34Z,use_quota=True,user_id='adae624f2a994226a21e5075ea2ac189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Creating volume 9f36115f-2782-4510-81da-36924cf59c2e {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:02:34 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9f36115f-2782-4510-81da-36924cf59c2e 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:34 devstack sudo[91794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9f36115f-2782-4510-81da-36924cf59c2e 1073741824 Sep 28 16:02:34 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:34 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9f36115f-2782-4510-81da-36924cf59c2e 1073741824" returned: 0 in 0.698s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9f36115f-2782-4510-81da-36924cf59c2e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:34 devstack sudo[91801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9f36115f-2782-4510-81da-36924cf59c2e Sep 28 16:02:34 devstack sudo[91801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:35 devstack sudo[91803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:02:35 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Flow 'volume_create_manager' (e8ace68b-0fec-45b8-bc7e-3b57460b8c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fa003e-837f-4242-8b93-9693a93d6d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fa003e-837f-4242-8b93-9693a93d6d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-55886202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4839c41a-1c6f-4141-b401-d81fe1aff01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3022fc4edf4767817c4eda0c3b00cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:35Z,use_quota=True,user_id='caf1714dffed4e84b295f819021aa236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be3bf3e-4494-4322-8de7-8f2643bd0598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be3bf3e-4494-4322-8de7-8f2643bd0598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c92f9fb-a279-4bee-9a31-9f1a02c85a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:35 devstack sudo[91801]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c92f9fb-a279-4bee-9a31-9f1a02c85a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4839c41a-1c6f-4141-b401-d81fe1aff01f', 'volume_name': 'volume-4839c41a-1c6f-4141-b401-d81fe1aff01f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0fd486-d4bb-4e61-a1a5-6bafe6f327e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0fd486-d4bb-4e61-a1a5-6bafe6f327e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d88cf4a-1396-4ca2-af03-03b95b678ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:35 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Volume 4839c41a-1c6f-4141-b401-d81fe1aff01f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4839c41a-1c6f-4141-b401-d81fe1aff01f', 'volume_size': 1} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9f36115f-2782-4510-81da-36924cf59c2e" returned: 0 in 0.430s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-55886202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4839c41a-1c6f-4141-b401-d81fe1aff01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3022fc4edf4767817c4eda0c3b00cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:35Z,use_quota=True,user_id='caf1714dffed4e84b295f819021aa236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Creating volume 4839c41a-1c6f-4141-b401-d81fe1aff01f {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:02:35 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4839c41a-1c6f-4141-b401-d81fe1aff01f 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe62b36c-fbda-436d-8aaa-19376376ccb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f36115f-2782-4510-81da-36924cf59c2e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be13185-3ba5-4d55-8533-4cec0a295013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:35 devstack sudo[91806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4839c41a-1c6f-4141-b401-d81fe1aff01f 1073741824 Sep 28 16:02:35 devstack sudo[91806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:35 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Volume volume-9f36115f-2782-4510-81da-36924cf59c2e (9f36115f-2782-4510-81da-36924cf59c2e): created successfully Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be13185-3ba5-4d55-8533-4cec0a295013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Flow 'volume_create_manager' (5f15d12b-b216-4b45-b37d-67898f111e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:35 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5598585d-31a8-4097-b395-2e5fd427d794 tempest-AttachVolumeTestJSON-509626539 None] Created volume successfully. Sep 28 16:02:35 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.454s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 8 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:02:35 devstack sudo[91806]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4839c41a-1c6f-4141-b401-d81fe1aff01f 1073741824" returned: 0 in 0.638s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4839c41a-1c6f-4141-b401-d81fe1aff01f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:36 devstack sudo[91814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4839c41a-1c6f-4141-b401-d81fe1aff01f Sep 28 16:02:36 devstack sudo[91814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:36 devstack sudo[91814]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4839c41a-1c6f-4141-b401-d81fe1aff01f" returned: 0 in 0.418s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:02:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d88cf4a-1396-4ca2-af03-03b95b678ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4839c41a-1c6f-4141-b401-d81fe1aff01f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b557bc-a7de-42ff-8b5e-959cc680d46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:36 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Volume volume-4839c41a-1c6f-4141-b401-d81fe1aff01f (4839c41a-1c6f-4141-b401-d81fe1aff01f): created successfully Sep 28 16:02:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b557bc-a7de-42ff-8b5e-959cc680d46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Flow 'volume_create_manager' (e8ace68b-0fec-45b8-bc7e-3b57460b8c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-61b53f2f-50b3-4a4d-88a1-699aa4a97842 tempest-VolumesListAdminTestJSON-1229398533 None] Created volume successfully. Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-91a0e4fe-ad44-4c97-b919-4d6ca1710409 req-576d9011-8753-4ef3-b4b3-6781716bd375 tempest-AttachVolumeTestJSON-509626539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-91a0e4fe-ad44-4c97-b919-4d6ca1710409 req-576d9011-8753-4ef3-b4b3-6781716bd375 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-91a0e4fe-ad44-4c97-b919-4d6ca1710409 req-576d9011-8753-4ef3-b4b3-6781716bd375 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-91a0e4fe-ad44-4c97-b919-4d6ca1710409 req-576d9011-8753-4ef3-b4b3-6781716bd375 tempest-AttachVolumeTestJSON-509626539 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-9f36115f-2782-4510-81da-36924cf59c2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b519498e-9672-4ae8-b394-ec7476a4b61a', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:02:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-91a0e4fe-ad44-4c97-b919-4d6ca1710409 req-576d9011-8753-4ef3-b4b3-6781716bd375 tempest-AttachVolumeTestJSON-509626539 None] attachment_update completed successfully. Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Flow 'volume_create_manager' (908a7cd3-a86e-4381-b26f-b998358f57e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb5ad86-6080-4715-b8b9-8062cde64a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb5ad86-6080-4715-b8b9-8062cde64a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1453604421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a286a61-c217-4016-9981-b54b661ab6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3022fc4edf4767817c4eda0c3b00cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:38Z,use_quota=True,user_id='caf1714dffed4e84b295f819021aa236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2fa02f8-e5b9-48b0-bf78-a262cdbc2c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2fa02f8-e5b9-48b0-bf78-a262cdbc2c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d342f7-69c9-4152-ac5e-63de71de2e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d342f7-69c9-4152-ac5e-63de71de2e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a286a61-c217-4016-9981-b54b661ab6c4', 'volume_name': 'volume-3a286a61-c217-4016-9981-b54b661ab6c4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a10f3b-010b-4d75-9bd2-f13ce5e226f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a10f3b-010b-4d75-9bd2-f13ce5e226f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4575e8cb-17e3-40c5-a531-26303c57a937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:37 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Volume 3a286a61-c217-4016-9981-b54b661ab6c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a286a61-c217-4016-9981-b54b661ab6c4', 'volume_size': 1} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1453604421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a286a61-c217-4016-9981-b54b661ab6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3022fc4edf4767817c4eda0c3b00cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:38Z,use_quota=True,user_id='caf1714dffed4e84b295f819021aa236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Creating volume 3a286a61-c217-4016-9981-b54b661ab6c4 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:02:37 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:02:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3a286a61-c217-4016-9981-b54b661ab6c4 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:37 devstack sudo[91835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3a286a61-c217-4016-9981-b54b661ab6c4 1073741824 Sep 28 16:02:37 devstack sudo[91835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:38 devstack sudo[91835]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3a286a61-c217-4016-9981-b54b661ab6c4 1073741824" returned: 0 in 0.832s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3a286a61-c217-4016-9981-b54b661ab6c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:38 devstack sudo[91841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3a286a61-c217-4016-9981-b54b661ab6c4 Sep 28 16:02:38 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:39 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3a286a61-c217-4016-9981-b54b661ab6c4" returned: 0 in 0.292s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:02:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4575e8cb-17e3-40c5-a531-26303c57a937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a286a61-c217-4016-9981-b54b661ab6c4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b71ff51-e7f1-4906-8146-8aefd14f38ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:39 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Volume volume-3a286a61-c217-4016-9981-b54b661ab6c4 (3a286a61-c217-4016-9981-b54b661ab6c4): created successfully Sep 28 16:02:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b71ff51-e7f1-4906-8146-8aefd14f38ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Flow 'volume_create_manager' (908a7cd3-a86e-4381-b26f-b998358f57e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a5d66c2e-5fa3-46f7-bbc8-22f4531d5db4 tempest-VolumesListAdminTestJSON-1229398533 None] Created volume successfully. Sep 28 16:02:39 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:02:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Flow 'volume_create_manager' (8fa677ad-026e-4b85-87f9-7b2a41d72c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf285d0-10bc-435d-be8a-42bca1ceb95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf285d0-10bc-435d-be8a-42bca1ceb95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1318285938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab618d18943a49b49d8c130cc1b33541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:40Z,use_quota=True,user_id='adae624f2a994226a21e5075ea2ac189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf930b56-7f41-47df-88ff-c70e0cb05693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf930b56-7f41-47df-88ff-c70e0cb05693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0023a9-971f-4748-9501-eb5e4e5be0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0023a9-971f-4748-9501-eb5e4e5be0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3', 'volume_name': 'volume-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9e80af-046a-4998-9db5-5c3e7d6dd12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9e80af-046a-4998-9db5-5c3e7d6dd12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c19017fa-95d6-4335-b213-79af244c1c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:40 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Volume 401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3', 'volume_size': 1} Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1318285938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab618d18943a49b49d8c130cc1b33541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:40Z,use_quota=True,user_id='adae624f2a994226a21e5075ea2ac189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Creating volume 401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:02:40 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:40 devstack sudo[91844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3 1073741824 Sep 28 16:02:40 devstack sudo[91844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:40 devstack sudo[91844]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3 1073741824" returned: 0 in 0.663s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:40 devstack sudo[91888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3 Sep 28 16:02:40 devstack sudo[91888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Flow 'volume_create_manager' (58e20f0c-193f-4ca8-af0a-71cdaf7c1904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a7c357-659f-49da-9a36-2c309f269aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a7c357-659f-49da-9a36-2c309f269aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ddb9da6-d3f5-40d7-bd49-b02171b183b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c134dccd346048fcb6743b06b1605332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:41Z,use_quota=True,user_id='7d6e77f6c2704b828d17883582b7503f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e2fd1a-ee14-48f8-9de5-f91b092cc628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e2fd1a-ee14-48f8-9de5-f91b092cc628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:41 devstack sudo[91888]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349575b4-0126-434c-b2bb-b821601d60f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349575b4-0126-434c-b2bb-b821601d60f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ddb9da6-d3f5-40d7-bd49-b02171b183b8', 'volume_name': 'volume-3ddb9da6-d3f5-40d7-bd49-b02171b183b8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ef5f04-530a-49a1-84e3-9a032284ab36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ef5f04-530a-49a1-84e3-9a032284ab36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef9d8c1-d7de-46e2-a253-6ed9daeb8e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:41 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Volume 3ddb9da6-d3f5-40d7-bd49-b02171b183b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ddb9da6-d3f5-40d7-bd49-b02171b183b8', 'volume_size': 1} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3" returned: 0 in 0.497s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ddb9da6-d3f5-40d7-bd49-b02171b183b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c134dccd346048fcb6743b06b1605332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:41Z,use_quota=True,user_id='7d6e77f6c2704b828d17883582b7503f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Creating volume 3ddb9da6-d3f5-40d7-bd49-b02171b183b8 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:02:41 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3ddb9da6-d3f5-40d7-bd49-b02171b183b8 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:41 devstack sudo[91892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3ddb9da6-d3f5-40d7-bd49-b02171b183b8 1073741824 Sep 28 16:02:41 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c19017fa-95d6-4335-b213-79af244c1c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e6da3d4-620a-4137-878f-2ccfffc19acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:41 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Volume volume-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3 (401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3): created successfully Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e6da3d4-620a-4137-878f-2ccfffc19acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Flow 'volume_create_manager' (8fa677ad-026e-4b85-87f9-7b2a41d72c24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:41 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7fa60fe7-bc82-4f78-87b8-60f33ca6e85b tempest-AttachVolumeTestJSON-509626539 None] Created volume successfully. Sep 28 16:02:41 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3ddb9da6-d3f5-40d7-bd49-b02171b183b8 1073741824" returned: 0 in 0.533s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3ddb9da6-d3f5-40d7-bd49-b02171b183b8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:41 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3ddb9da6-d3f5-40d7-bd49-b02171b183b8 Sep 28 16:02:41 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:42 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3ddb9da6-d3f5-40d7-bd49-b02171b183b8" returned: 0 in 0.329s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:02:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef9d8c1-d7de-46e2-a253-6ed9daeb8e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ddb9da6-d3f5-40d7-bd49-b02171b183b8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333874a7-f16c-445e-98f4-83630ddb5006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:42 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Volume volume-3ddb9da6-d3f5-40d7-bd49-b02171b183b8 (3ddb9da6-d3f5-40d7-bd49-b02171b183b8): created successfully Sep 28 16:02:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333874a7-f16c-445e-98f4-83630ddb5006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Flow 'volume_create_manager' (58e20f0c-193f-4ca8-af0a-71cdaf7c1904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1b7f604e-128b-44fc-88ab-2d02ac694c1b tempest-VolumesListAdminTestJSON-1735787830 None] Created volume successfully. Sep 28 16:02:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-bba2a7e5-fb08-4cfc-8cda-042de967ba30 req-ebd026af-b008-4842-92c9-d3c4a8a6a883 tempest-AttachVolumeTestJSON-509626539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-bba2a7e5-fb08-4cfc-8cda-042de967ba30 req-ebd026af-b008-4842-92c9-d3c4a8a6a883 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-bba2a7e5-fb08-4cfc-8cda-042de967ba30 req-ebd026af-b008-4842-92c9-d3c4a8a6a883 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-bba2a7e5-fb08-4cfc-8cda-042de967ba30 req-ebd026af-b008-4842-92c9-d3c4a8a6a883 tempest-AttachVolumeTestJSON-509626539 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '158bb8fb-30ca-42b2-ae7b-a9db7ba89d22', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:02:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-bba2a7e5-fb08-4cfc-8cda-042de967ba30 req-ebd026af-b008-4842-92c9-d3c4a8a6a883 tempest-AttachVolumeTestJSON-509626539 None] attachment_update completed successfully. Sep 28 16:02:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] Acquiring lock "cinder-3ddb9da6-d3f5-40d7-bd49-b02171b183b8-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] Lock "cinder-3ddb9da6-d3f5-40d7-bd49-b02171b183b8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] Acquiring lock "cinder-quobyte-3ddb9da6-d3f5-40d7-bd49-b02171b183b8" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] Lock "cinder-quobyte-3ddb9da6-d3f5-40d7-bd49-b02171b183b8" acquired by "delete_volume" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:43 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7092653-65f1-4bf7-a6d3-6ef0a43b5362]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3ddb9da6-d3f5-40d7-bd49-b02171b183b8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] Acquiring lock "cinder-3a286a61-c217-4016-9981-b54b661ab6c4-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] Lock "cinder-3a286a61-c217-4016-9981-b54b661ab6c4-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] Acquiring lock "cinder-quobyte-3a286a61-c217-4016-9981-b54b661ab6c4" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] Lock "cinder-quobyte-3a286a61-c217-4016-9981-b54b661ab6c4" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:44 devstack sudo[91943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3ddb9da6-d3f5-40d7-bd49-b02171b183b8 Sep 28 16:02:44 devstack sudo[91943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:44 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b14eb6b-a9bb-4f5b-b1c2-477e62dd5aad]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3a286a61-c217-4016-9981-b54b661ab6c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:44 devstack sudo[91945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3a286a61-c217-4016-9981-b54b661ab6c4 Sep 28 16:02:44 devstack sudo[91945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:44 devstack sudo[91943]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3ddb9da6-d3f5-40d7-bd49-b02171b183b8" returned: 0 in 0.631s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3ddb9da6-d3f5-40d7-bd49-b02171b183b8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:44 devstack sudo[91950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3ddb9da6-d3f5-40d7-bd49-b02171b183b8 Sep 28 16:02:44 devstack sudo[91950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:44 devstack sudo[91945]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3a286a61-c217-4016-9981-b54b661ab6c4" returned: 0 in 0.538s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3a286a61-c217-4016-9981-b54b661ab6c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:44 devstack sudo[91956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3a286a61-c217-4016-9981-b54b661ab6c4 Sep 28 16:02:44 devstack sudo[91956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:44 devstack sudo[91950]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3ddb9da6-d3f5-40d7-bd49-b02171b183b8" returned: 0 in 0.294s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] Lock "cinder-quobyte-3ddb9da6-d3f5-40d7-bd49-b02171b183b8" released by "delete_volume" :: held 1.020s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:44 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] Created reservations ['2f2a49d7-7eba-4bf1-a7ac-13f4ed07b68c', 'a851857a-9f6b-4508-94f6-e39b81a3a65c', 'eef43299-8ca5-4d7e-a8fd-7182d7175bf9', '368af082-1a11-40bc-b9fb-a9e7fd38ff2b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:02:45 devstack sudo[91956]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3a286a61-c217-4016-9981-b54b661ab6c4" returned: 0 in 0.324s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] Lock "cinder-quobyte-3a286a61-c217-4016-9981-b54b661ab6c4" released by "delete_volume" :: held 0.957s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:45 devstack sudo[91960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:02:45 devstack sudo[91960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] Created reservations ['c5fc22af-6bfc-46a4-8e83-7113b419b93e', 'b6f8ed97-94e8-4b99-9bc5-28518773bbf3', '83dc0869-9845-4b8c-b35b-b18a452eadfa', '29ea2322-3dac-461f-a302-a464ecf0d4cb'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:45 devstack sudo[91964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:02:45 devstack sudo[91964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:45 devstack sudo[91960]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.351s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:02:45 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] Deleted volume successfully. Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7920a4b3-f291-4830-8080-ebfec0bac594 tempest-VolumesListAdminTestJSON-1735787830 None] Lock "cinder-3ddb9da6-d3f5-40d7-bd49-b02171b183b8-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:45 devstack sudo[91964]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.349s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:02:45 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] Deleted volume successfully. Sep 28 16:02:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-17fb59af-0c32-4295-b141-16eea8bcfd2f tempest-VolumesListAdminTestJSON-1229398533 None] Lock "cinder-3a286a61-c217-4016-9981-b54b661ab6c4-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:46 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-d040067e-9959-4e3c-9c37-739e7e543b33 req-74c66529-3e59-4605-ac8f-332a32c05fa5 tempest-AttachVolumeTestJSON-509626539 None] Terminate volume connection completed successfully. Sep 28 16:02:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-d040067e-9959-4e3c-9c37-739e7e543b33 req-74c66529-3e59-4605-ac8f-332a32c05fa5 tempest-AttachVolumeTestJSON-509626539 None] Deleting attachment b519498e-9672-4ae8-b394-ec7476a4b61a. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:02:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] Acquiring lock "cinder-4839c41a-1c6f-4141-b401-d81fe1aff01f-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "cinder-4839c41a-1c6f-4141-b401-d81fe1aff01f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] Acquiring lock "cinder-quobyte-4839c41a-1c6f-4141-b401-d81fe1aff01f" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "cinder-quobyte-4839c41a-1c6f-4141-b401-d81fe1aff01f" acquired by "delete_volume" :: waited 0.057s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:46 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[442ece86-ea01-4d38-bee8-656ed5452f84]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4839c41a-1c6f-4141-b401-d81fe1aff01f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:46 devstack sudo[91975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4839c41a-1c6f-4141-b401-d81fe1aff01f Sep 28 16:02:46 devstack sudo[91975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:47 devstack sudo[91975]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4839c41a-1c6f-4141-b401-d81fe1aff01f" returned: 0 in 0.420s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4839c41a-1c6f-4141-b401-d81fe1aff01f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:47 devstack sudo[91980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4839c41a-1c6f-4141-b401-d81fe1aff01f Sep 28 16:02:47 devstack sudo[91980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:47 devstack sudo[91980]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4839c41a-1c6f-4141-b401-d81fe1aff01f" returned: 0 in 0.366s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "cinder-quobyte-4839c41a-1c6f-4141-b401-d81fe1aff01f" released by "delete_volume" :: held 0.853s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] Created reservations ['5ef3ebb3-3dd9-4820-9a9b-6562cebe27e1', 'e79c3fe9-fcea-4d52-bd11-007d527b33b9', '041b9ad8-95e0-44b2-80da-30f26babd4f4', 'b696a4b8-963d-4b1d-865d-6daa2e4c9711'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:47 devstack sudo[91985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:02:47 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] Acquiring lock "cinder-e70cfeff-502e-44fa-a0db-85f61f757619-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "cinder-e70cfeff-502e-44fa-a0db-85f61f757619-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] Acquiring lock "cinder-quobyte-e70cfeff-502e-44fa-a0db-85f61f757619" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "cinder-quobyte-e70cfeff-502e-44fa-a0db-85f61f757619" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c758416-3af9-403d-972a-f5c0cf27363e]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e70cfeff-502e-44fa-a0db-85f61f757619 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:47 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.380s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:02:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-a59af3c5-f5f4-48a7-82fa-9178162de2b0 req-793ff028-9a06-42ba-bd42-d027a1562c10 tempest-AttachVolumeTestJSON-509626539 None] Terminate volume connection completed successfully. Sep 28 16:02:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-a59af3c5-f5f4-48a7-82fa-9178162de2b0 req-793ff028-9a06-42ba-bd42-d027a1562c10 tempest-AttachVolumeTestJSON-509626539 None] Deleting attachment 158bb8fb-30ca-42b2-ae7b-a9db7ba89d22. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:02:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] Deleted volume successfully. Sep 28 16:02:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-58f55519-796a-40b1-9b2a-624473e24611 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "cinder-4839c41a-1c6f-4141-b401-d81fe1aff01f-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:48 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e70cfeff-502e-44fa-a0db-85f61f757619 Sep 28 16:02:48 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:48 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e70cfeff-502e-44fa-a0db-85f61f757619" returned: 0 in 0.491s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e70cfeff-502e-44fa-a0db-85f61f757619 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:48 devstack sudo[91998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e70cfeff-502e-44fa-a0db-85f61f757619 Sep 28 16:02:48 devstack sudo[91998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:48 devstack sudo[91998]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e70cfeff-502e-44fa-a0db-85f61f757619" returned: 0 in 0.293s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "cinder-quobyte-e70cfeff-502e-44fa-a0db-85f61f757619" released by "delete_volume" :: held 0.844s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:48 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] Created reservations ['d3362c47-c9ed-42c5-af46-16cc45333b59', '011f67ed-d24e-4928-96b8-03564ffa7d3f', '284dcb8f-916a-4a0a-87ff-fcd1f66b3290', '3b127a27-9e5a-4290-a9bc-d1b0408c0ffa'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:02:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:48 devstack sudo[92001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:02:48 devstack sudo[92001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:49 devstack sudo[92001]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.480s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:49 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:02:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] Deleted volume successfully. Sep 28 16:02:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d8867c09-a524-46e6-a99d-457ad8cd9632 tempest-VolumesListAdminTestJSON-1229398533 None] Lock "cinder-e70cfeff-502e-44fa-a0db-85f61f757619-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] Acquiring lock "cinder-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] Lock "cinder-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] Acquiring lock "cinder-quobyte-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] Lock "cinder-quobyte-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3" acquired by "delete_volume" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:54 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c9c441-e9da-4f32-ae55-89bf17b37c3f]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:54 devstack sudo[92036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3 Sep 28 16:02:54 devstack sudo[92036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:54 devstack sudo[92036]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3" returned: 0 in 0.476s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:54 devstack sudo[92042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3 Sep 28 16:02:54 devstack sudo[92042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:55 devstack sudo[92042]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3" returned: 0 in 0.311s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] Lock "cinder-quobyte-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3" released by "delete_volume" :: held 0.876s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:55 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] Created reservations ['4af41afe-a774-49c1-b0d5-396a2093abb9', '9362aad1-8615-4566-bb3d-62e51e5e6cbb', '7b71260a-a94b-4543-bf10-b199a42cb0ee', '33e88870-f449-4e3d-ae1e-20814cdca6d2'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:02:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:55 devstack sudo[92045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:02:55 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] Acquiring lock "cinder-9f36115f-2782-4510-81da-36924cf59c2e-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] Lock "cinder-9f36115f-2782-4510-81da-36924cf59c2e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] Acquiring lock "cinder-quobyte-9f36115f-2782-4510-81da-36924cf59c2e" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] Lock "cinder-quobyte-9f36115f-2782-4510-81da-36924cf59c2e" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:55 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82f3e80-f172-4cba-b6e7-11a24f582e6a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9f36115f-2782-4510-81da-36924cf59c2e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:55 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.392s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:55 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:02:55 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] Deleted volume successfully. Sep 28 16:02:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5617252a-cda3-4cb8-aae9-e5d5473b19c2 tempest-AttachVolumeTestJSON-509626539 None] Lock "cinder-401e5b71-f854-4d4b-8a6f-6b4a8a0c61e3-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:55 devstack sudo[92047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9f36115f-2782-4510-81da-36924cf59c2e Sep 28 16:02:55 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:56 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9f36115f-2782-4510-81da-36924cf59c2e" returned: 0 in 0.466s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9f36115f-2782-4510-81da-36924cf59c2e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:56 devstack sudo[92054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9f36115f-2782-4510-81da-36924cf59c2e Sep 28 16:02:56 devstack sudo[92054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:56 devstack sudo[92054]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9f36115f-2782-4510-81da-36924cf59c2e" returned: 0 in 0.299s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] Lock "cinder-quobyte-9f36115f-2782-4510-81da-36924cf59c2e" released by "delete_volume" :: held 0.829s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:56 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] Created reservations ['b22c5617-e8f4-4071-87ee-71aefba51d44', '61b52d5b-fc3f-4e0e-a439-32a3f1b9b349', 'e4e120aa-c319-4465-a480-7a7a6449b848', '9ce6f0b6-e98f-4d8e-b2f4-ac24a15540c7'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:02:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:56 devstack sudo[92057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:02:56 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] Acquiring lock "cinder-9fc498e5-e189-4183-9864-43ab3615db69-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] Lock "cinder-9fc498e5-e189-4183-9864-43ab3615db69-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] Acquiring lock "cinder-quobyte-9fc498e5-e189-4183-9864-43ab3615db69" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] Lock "cinder-quobyte-9fc498e5-e189-4183-9864-43ab3615db69" acquired by "delete_volume" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:56 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3a189c-ce41-4f52-b7b7-e26f3ff57415]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9fc498e5-e189-4183-9864-43ab3615db69 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:56 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.408s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:56 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:02:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] Deleted volume successfully. Sep 28 16:02:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3142461a-f6fb-48bd-8d9a-60a979a53918 tempest-AttachVolumeTestJSON-509626539 None] Lock "cinder-9f36115f-2782-4510-81da-36924cf59c2e-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:57 devstack sudo[92060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9fc498e5-e189-4183-9864-43ab3615db69 Sep 28 16:02:57 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:57 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9fc498e5-e189-4183-9864-43ab3615db69" returned: 0 in 0.469s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9fc498e5-e189-4183-9864-43ab3615db69 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:57 devstack sudo[92068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9fc498e5-e189-4183-9864-43ab3615db69 Sep 28 16:02:57 devstack sudo[92068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:57 devstack sudo[92068]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9fc498e5-e189-4183-9864-43ab3615db69" returned: 0 in 0.308s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] Lock "cinder-quobyte-9fc498e5-e189-4183-9864-43ab3615db69" released by "delete_volume" :: held 0.830s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:57 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] Created reservations ['393e556d-d986-406a-bbf7-9fd62e370028', '183c1f76-ba8f-4547-b36d-60511a1d8d06', 'd382e2ee-034f-4bd3-a81b-a0b924766fbf', 'b9b68026-d131-46b3-8460-de4e3f949cae'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:58 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:02:58 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Flow 'volume_create_manager' (b60793da-b4ed-4dd2-bf41-509a52a43874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1dfb64-c3ec-4d1b-95d4-e53f5b17033c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1dfb64-c3ec-4d1b-95d4-e53f5b17033c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1350823881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c684714-f7db-435b-aec6-b69125bbd6ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0cacdf709754b008b70945215cb508f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:58Z,use_quota=True,user_id='83fda73225c648f09bc7941c1bbee528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f5ba84-768f-466b-9fa9-efcce14bca2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f5ba84-768f-466b-9fa9-efcce14bca2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4f5258-f806-476b-aeae-8ac428bfbddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:02:58 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.444s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:02:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] Deleted volume successfully. Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47ba8535-52ef-4e43-bad6-dbf624326880 tempest-AttachVolumeTestJSON-509626539 None] Lock "cinder-9fc498e5-e189-4183-9864-43ab3615db69-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4f5258-f806-476b-aeae-8ac428bfbddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c684714-f7db-435b-aec6-b69125bbd6ed', 'volume_name': 'volume-8c684714-f7db-435b-aec6-b69125bbd6ed', 'volume_size': 1, 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3682e9714c0d4e0582fb2ca18f45f417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'created_at': datetime.datetime(2026, 9, 28, 13, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7abc4afd-c71a-462f-b806-ba7da0f478cc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccffa9bf-7cdb-4b37-8ea4-38a3d10f7b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccffa9bf-7cdb-4b37-8ea4-38a3d10f7b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fc4d4f-7a65-4b77-857f-7c96da25c1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:58 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Volume 8c684714-f7db-435b-aec6-b69125bbd6ed: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c684714-f7db-435b-aec6-b69125bbd6ed', 'volume_size': 1, 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3682e9714c0d4e0582fb2ca18f45f417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'created_at': datetime.datetime(2026, 9, 28, 13, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7abc4afd-c71a-462f-b806-ba7da0f478cc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 16:02:58 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Trying to clone 8c684714-f7db-435b-aec6-b69125bbd6ed from image 7abc4afd-c71a-462f-b806-ba7da0f478cc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:02:59 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_h1w1wvxsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:02:59 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Image download 20.69 MB at 20.69 MB/s Sep 28 16:02:59 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f190c6-3e69-42ab-b9bf-58a4381f3f0d]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_h1w1wvxsdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:59 devstack sudo[92098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_h1w1wvxsdevstack@QuobyteHD Sep 28 16:02:59 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:59 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_h1w1wvxsdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:59 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Temporary image 7abc4afd-c71a-462f-b806-ba7da0f478cc is fetched for user 83fda73225c648f09bc7941c1bbee528. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:02:59 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e695231-e6a1-46bc-ad3c-2f6b1c7ac683]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_h1w1wvxsdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:00 devstack sudo[92117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_h1w1wvxsdevstack@QuobyteHD Sep 28 16:03:00 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:00 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_h1w1wvxsdevstack@QuobyteHD" returned: 0 in 0.503s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1350823881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c684714-f7db-435b-aec6-b69125bbd6ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0cacdf709754b008b70945215cb508f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:58Z,use_quota=True,user_id='83fda73225c648f09bc7941c1bbee528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:03:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Creating volume 8c684714-f7db-435b-aec6-b69125bbd6ed {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:03:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:03:00 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:03:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c684714-f7db-435b-aec6-b69125bbd6ed 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:00 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c684714-f7db-435b-aec6-b69125bbd6ed 1073741824 Sep 28 16:03:00 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:01 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c684714-f7db-435b-aec6-b69125bbd6ed 1073741824" returned: 0 in 0.537s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c684714-f7db-435b-aec6-b69125bbd6ed {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:01 devstack sudo[92134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c684714-f7db-435b-aec6-b69125bbd6ed Sep 28 16:03:01 devstack sudo[92134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:01 devstack sudo[92134]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c684714-f7db-435b-aec6-b69125bbd6ed" returned: 0 in 0.331s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:03:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:01 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Attempting download of 7abc4afd-c71a-462f-b806-ba7da0f478cc ((None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}])) to volume 8c684714-f7db-435b-aec6-b69125bbd6ed. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:03:01 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75fb0b3-7002-4b66-9c85-90b5caf22103]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_301ryrk2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:01 devstack sudo[92137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_301ryrk2 Sep 28 16:03:01 devstack sudo[92137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:02 devstack sudo[92137]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_301ryrk2" returned: 0 in 0.492s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_301ryrk2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:02 devstack sudo[92141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_301ryrk2 Sep 28 16:03:02 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:02 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_301ryrk2" returned: 1 in 0.421s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_301ryrk2' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:03:02 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3363253-9fb0-4e44-aa86-6f3274a8c843]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_h1w1wvxsdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:02 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_h1w1wvxsdevstack@QuobyteHD Sep 28 16:03:02 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:02 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_h1w1wvxsdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:02 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] 7abc4afd-c71a-462f-b806-ba7da0f478cc was qcow2, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:03:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_h1w1wvxsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c684714-f7db-435b-aec6-b69125bbd6ed {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:02 devstack sudo[92152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_h1w1wvxsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c684714-f7db-435b-aec6-b69125bbd6ed Sep 28 16:03:02 devstack sudo[92152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:06 devstack sudo[92152]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_h1w1wvxsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c684714-f7db-435b-aec6-b69125bbd6ed" returned: 0 in 3.575s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:06 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_h1w1wvxsdevstack@QuobyteHD, size 112.00 MB, duration 3.58 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c684714-f7db-435b-aec6-b69125bbd6ed {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:03:06 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Converted 112.00 MB image at 31.32 MB/s Sep 28 16:03:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c684714-f7db-435b-aec6-b69125bbd6ed 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:06 devstack sudo[92254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c684714-f7db-435b-aec6-b69125bbd6ed 1G Sep 28 16:03:06 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-e4a8d1aa-52af-4a8b-b3c5-e0246206eff8 req-75db3e95-a2d2-40f8-b23f-c796b8fb11a7 tempest-ServerActionsTestOtherA-1617816428 None] Terminate volume connection completed successfully. Sep 28 16:03:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-e4a8d1aa-52af-4a8b-b3c5-e0246206eff8 req-75db3e95-a2d2-40f8-b23f-c796b8fb11a7 tempest-ServerActionsTestOtherA-1617816428 None] Deleting attachment 6bf959c7-6b5b-42b0-8bca-fa26562ef7da. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:03:07 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c684714-f7db-435b-aec6-b69125bbd6ed 1G" returned: 0 in 0.944s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:07 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Downloaded image 7abc4afd-c71a-462f-b806-ba7da0f478cc ((None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}])) to volume 8c684714-f7db-435b-aec6-b69125bbd6ed successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:03:07 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Temporary image 7abc4afd-c71a-462f-b806-ba7da0f478cc for user 83fda73225c648f09bc7941c1bbee528 is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:03:07 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Marking volume 8c684714-f7db-435b-aec6-b69125bbd6ed as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:03:07 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=100,cinder:INSERT=17,cinder:UPDATE=98,cinder:DELETE=9 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:03:07 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Copying metadata from image 7abc4afd-c71a-462f-b806-ba7da0f478cc to 8c684714-f7db-435b-aec6-b69125bbd6ed. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:03:07 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Creating volume glance metadata for volume 8c684714-f7db-435b-aec6-b69125bbd6ed backed by image 7abc4afd-c71a-462f-b806-ba7da0f478cc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:03:07 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=90,cinder:UPDATE=113,cinder:DELETE=8,cinder:INSERT=29 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:03:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fc4d4f-7a65-4b77-857f-7c96da25c1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c684714-f7db-435b-aec6-b69125bbd6ed', 'volume_size': 1, 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3682e9714c0d4e0582fb2ca18f45f417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'created_at': datetime.datetime(2026, 9, 28, 13, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7abc4afd-c71a-462f-b806-ba7da0f478cc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb002ea-93fa-4507-a66a-b9af19f073bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:07 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Volume volume-8c684714-f7db-435b-aec6-b69125bbd6ed (8c684714-f7db-435b-aec6-b69125bbd6ed): created successfully Sep 28 16:03:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb002ea-93fa-4507-a66a-b9af19f073bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Flow 'volume_create_manager' (b60793da-b4ed-4dd2-bf41-509a52a43874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6e1d7bf1-cdb6-46d5-9d9a-2ca34823a38f tempest-VolumesImageMetadata-1809594523 None] Created volume successfully. Sep 28 16:03:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] Acquiring lock "cinder-8c684714-f7db-435b-aec6-b69125bbd6ed-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] Lock "cinder-8c684714-f7db-435b-aec6-b69125bbd6ed-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] Acquiring lock "cinder-quobyte-8c684714-f7db-435b-aec6-b69125bbd6ed" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] Lock "cinder-quobyte-8c684714-f7db-435b-aec6-b69125bbd6ed" acquired by "delete_volume" :: waited 0.072s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:10 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b076bf55-3cca-446c-9300-d6b8affe3a4a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c684714-f7db-435b-aec6-b69125bbd6ed {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:10 devstack sudo[92337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c684714-f7db-435b-aec6-b69125bbd6ed Sep 28 16:03:10 devstack sudo[92337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:11 devstack sudo[92337]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c684714-f7db-435b-aec6-b69125bbd6ed" returned: 0 in 0.939s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c684714-f7db-435b-aec6-b69125bbd6ed {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:11 devstack sudo[92358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c684714-f7db-435b-aec6-b69125bbd6ed Sep 28 16:03:11 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:11 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c684714-f7db-435b-aec6-b69125bbd6ed" returned: 0 in 0.516s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] Lock "cinder-quobyte-8c684714-f7db-435b-aec6-b69125bbd6ed" released by "delete_volume" :: held 1.620s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:12 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] Created reservations ['3178e04f-d46a-4a38-aa78-0672ab773de5', 'f2537989-29c0-4b88-b020-ef809be6ec29', 'e6cdfe78-83ac-4961-9651-91027365d142', '07f04e58-4d31-45b3-b250-757f03de7a44'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:03:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:12 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:03:12 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:12 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.627s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:12 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:03:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] Deleted volume successfully. Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b999990-57ac-4232-a0c1-6b11ccebbb89 tempest-VolumesImageMetadata-1809594523 None] Lock "cinder-8c684714-f7db-435b-aec6-b69125bbd6ed-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Flow 'volume_create_manager' (d9175361-3357-49da-ba29-8bf4e9426262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426c9da2-34b9-4f98-a9e7-c7caed3b0a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426c9da2-34b9-4f98-a9e7-c7caed3b0a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1660153542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74118e53-1fee-4d0e-ad4c-775fb07a8c7d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56271fa8d55944379eb9f5f940e97b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:13Z,use_quota=True,user_id='61952f0a040b4e03ac489b10ce436462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf1c79e-cd28-41a5-926c-03f2f9c71ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf1c79e-cd28-41a5-926c-03f2f9c71ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db582bca-5b90-4eec-aa6d-a04a5a14e27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db582bca-5b90-4eec-aa6d-a04a5a14e27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74118e53-1fee-4d0e-ad4c-775fb07a8c7d', 'volume_name': 'volume-74118e53-1fee-4d0e-ad4c-775fb07a8c7d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3208e985-c350-4a85-96cf-a5b235ab5d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3208e985-c350-4a85-96cf-a5b235ab5d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a488252-5a6e-44fb-9f55-2891a9d122a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:13 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Volume 74118e53-1fee-4d0e-ad4c-775fb07a8c7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74118e53-1fee-4d0e-ad4c-775fb07a8c7d', 'volume_size': 1} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1660153542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74118e53-1fee-4d0e-ad4c-775fb07a8c7d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56271fa8d55944379eb9f5f940e97b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:13Z,use_quota=True,user_id='61952f0a040b4e03ac489b10ce436462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Creating volume 74118e53-1fee-4d0e-ad4c-775fb07a8c7d {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:03:13 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:03:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-74118e53-1fee-4d0e-ad4c-775fb07a8c7d 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:13 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-74118e53-1fee-4d0e-ad4c-775fb07a8c7d 1073741824 Sep 28 16:03:13 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:14 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-74118e53-1fee-4d0e-ad4c-775fb07a8c7d 1073741824" returned: 0 in 0.894s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-74118e53-1fee-4d0e-ad4c-775fb07a8c7d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:14 devstack sudo[92375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-74118e53-1fee-4d0e-ad4c-775fb07a8c7d Sep 28 16:03:14 devstack sudo[92375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:15 devstack sudo[92375]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-74118e53-1fee-4d0e-ad4c-775fb07a8c7d" returned: 0 in 0.473s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:03:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a488252-5a6e-44fb-9f55-2891a9d122a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74118e53-1fee-4d0e-ad4c-775fb07a8c7d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e048ad-d73e-4c82-a54d-d32a9364ca6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:15 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Volume volume-74118e53-1fee-4d0e-ad4c-775fb07a8c7d (74118e53-1fee-4d0e-ad4c-775fb07a8c7d): created successfully Sep 28 16:03:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e048ad-d73e-4c82-a54d-d32a9364ca6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Flow 'volume_create_manager' (d9175361-3357-49da-ba29-8bf4e9426262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:15 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-cf785fd9-b4d8-4876-8dfc-69f244f4f5ba req-a4dcd873-48b7-4ded-91a0-15fae51ad8f9 tempest-VolumesGetTestJSON-1382580260 None] Created volume successfully. Sep 28 16:03:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] Acquiring lock "cinder-74118e53-1fee-4d0e-ad4c-775fb07a8c7d-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] Lock "cinder-74118e53-1fee-4d0e-ad4c-775fb07a8c7d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] Acquiring lock "cinder-quobyte-74118e53-1fee-4d0e-ad4c-775fb07a8c7d" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] Lock "cinder-quobyte-74118e53-1fee-4d0e-ad4c-775fb07a8c7d" acquired by "delete_volume" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:16 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[007b8084-28c0-418a-947c-071e6758ec1e]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-74118e53-1fee-4d0e-ad4c-775fb07a8c7d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:16 devstack sudo[92379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-74118e53-1fee-4d0e-ad4c-775fb07a8c7d Sep 28 16:03:16 devstack sudo[92379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:17 devstack sudo[92379]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-74118e53-1fee-4d0e-ad4c-775fb07a8c7d" returned: 0 in 0.533s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-74118e53-1fee-4d0e-ad4c-775fb07a8c7d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:17 devstack sudo[92384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-74118e53-1fee-4d0e-ad4c-775fb07a8c7d Sep 28 16:03:17 devstack sudo[92384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:17 devstack sudo[92384]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-74118e53-1fee-4d0e-ad4c-775fb07a8c7d" returned: 0 in 0.587s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] Lock "cinder-quobyte-74118e53-1fee-4d0e-ad4c-775fb07a8c7d" released by "delete_volume" :: held 1.192s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:17 devstack cinder-volume[87087]: DEBUG cinder.quota [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] Created reservations ['f324b3a5-8e54-4924-8712-31144faa1696', 'd45bc6a4-ba21-47a1-8155-92ce1dc9594b', '7c5ac7dd-ebea-4e7d-a294-e374ffcd6778', '561a7a53-f915-48f2-b5c9-acc684e4c21f'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:03:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:17 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:03:17 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:18 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.391s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:18 devstack cinder-volume[87087]: DEBUG cinder.manager [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:03:18 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] Deleted volume successfully. Sep 28 16:03:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-899e276f-95e3-4691-ac9a-68837b55db95 req-0701b432-e843-450e-82f9-6bf3abae10e9 tempest-VolumesGetTestJSON-1382580260 None] Lock "cinder-74118e53-1fee-4d0e-ad4c-775fb07a8c7d-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:19 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:03:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Flow 'volume_create_manager' (26090579-ae65-4785-aacf-4f6a1ecaf251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d30faab7-a16b-4322-b7d6-81d558dd579e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d30faab7-a16b-4322-b7d6-81d558dd579e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-513121473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9ef84a-41b3-457c-a4cb-2ad8158c8e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f977af7f57142feb4f0f88ebbddd02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:20Z,use_quota=True,user_id='1d4014feb3614e97b48ee8ff5f1544d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa695a03-c6ef-492a-b7e5-1b81b7d3b9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa695a03-c6ef-492a-b7e5-1b81b7d3b9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1a9d3b-7670-4d22-a19d-a4986e9e7f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:20 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:03:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1a9d3b-7670-4d22-a19d-a4986e9e7f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be9ef84a-41b3-457c-a4cb-2ad8158c8e0d', 'volume_name': 'volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d', 'volume_size': 1, 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3682e9714c0d4e0582fb2ca18f45f417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'created_at': datetime.datetime(2026, 9, 28, 13, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7abc4afd-c71a-462f-b806-ba7da0f478cc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bcf7c4b-2937-4348-9135-67c6554c9406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bcf7c4b-2937-4348-9135-67c6554c9406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3988b06f-a1da-4aa3-9275-6fd582fa185d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:20 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Volume be9ef84a-41b3-457c-a4cb-2ad8158c8e0d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d', 'volume_size': 1, 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3682e9714c0d4e0582fb2ca18f45f417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'created_at': datetime.datetime(2026, 9, 28, 13, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7abc4afd-c71a-462f-b806-ba7da0f478cc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 16:03:20 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Trying to clone be9ef84a-41b3-457c-a4cb-2ad8158c8e0d from image 7abc4afd-c71a-462f-b806-ba7da0f478cc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:03:21 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_q5audbkldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:03:21 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Image download 20.69 MB at 20.69 MB/s Sep 28 16:03:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e604e9-3fce-42a6-ba9e-73b7d7f9b7b2]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_q5audbkldevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:21 devstack sudo[92427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_q5audbkldevstack@QuobyteHD Sep 28 16:03:21 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:21 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_q5audbkldevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:21 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Temporary image 7abc4afd-c71a-462f-b806-ba7da0f478cc is fetched for user 1d4014feb3614e97b48ee8ff5f1544d7. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:03:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4781a390-c405-448c-8ad6-dca4008a7817]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_q5audbkldevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:21 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_q5audbkldevstack@QuobyteHD Sep 28 16:03:21 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:22 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_q5audbkldevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-513121473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9ef84a-41b3-457c-a4cb-2ad8158c8e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f977af7f57142feb4f0f88ebbddd02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:20Z,use_quota=True,user_id='1d4014feb3614e97b48ee8ff5f1544d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:03:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Creating volume be9ef84a-41b3-457c-a4cb-2ad8158c8e0d {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:03:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:03:22 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:03:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:22 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d 1073741824 Sep 28 16:03:22 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:22 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d 1073741824" returned: 0 in 0.559s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:22 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d Sep 28 16:03:22 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:23 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d" returned: 0 in 0.294s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:03:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:23 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Attempting download of 7abc4afd-c71a-462f-b806-ba7da0f478cc ((None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}])) to volume be9ef84a-41b3-457c-a4cb-2ad8158c8e0d. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:03:23 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab721d2-491e-4fae-903d-b5b2d7918b3f]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_8tytwpax {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:23 devstack sudo[92452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_8tytwpax Sep 28 16:03:23 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:23 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_8tytwpax" returned: 0 in 0.418s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_8tytwpax {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:23 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_8tytwpax Sep 28 16:03:23 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:23 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_8tytwpax" returned: 1 in 0.380s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_8tytwpax' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:03:23 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[004d5fbf-385d-4f0a-b83b-4f0351ff2711]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_q5audbkldevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:24 devstack sudo[92460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_q5audbkldevstack@QuobyteHD Sep 28 16:03:24 devstack sudo[92460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:24 devstack sudo[92460]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_q5audbkldevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:24 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] 7abc4afd-c71a-462f-b806-ba7da0f478cc was qcow2, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:03:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_q5audbkldevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:24 devstack sudo[92465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_q5audbkldevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d Sep 28 16:03:24 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:24 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:03:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Flow 'volume_create_manager' (f5801fa8-5cd9-497d-8bf7-6eaabacd3611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12580b3f-c38a-427c-9ad8-67f4f7b490d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12580b3f-c38a-427c-9ad8-67f4f7b490d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-340939830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ba7b9c-2e90-4357-b166-ae7f05434a9b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7146bf72b1fb4883b2ae1ac09aa61f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:25Z,use_quota=True,user_id='eb8a1747bfc14b5985167d00cccc8866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef842764-a53d-4165-a751-51e23c0c3b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef842764-a53d-4165-a751-51e23c0c3b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609ebba9-5dff-43db-91aa-c26599d1fcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609ebba9-5dff-43db-91aa-c26599d1fcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ba7b9c-2e90-4357-b166-ae7f05434a9b', 'volume_name': 'volume-15ba7b9c-2e90-4357-b166-ae7f05434a9b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc1d9572-dcba-4a81-86bb-adc969f19cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc1d9572-dcba-4a81-86bb-adc969f19cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d136aa28-d74a-4a72-8f46-d5490ba33cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:25 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Volume 15ba7b9c-2e90-4357-b166-ae7f05434a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ba7b9c-2e90-4357-b166-ae7f05434a9b', 'volume_size': 1} Sep 28 16:03:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-340939830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ba7b9c-2e90-4357-b166-ae7f05434a9b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7146bf72b1fb4883b2ae1ac09aa61f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:25Z,use_quota=True,user_id='eb8a1747bfc14b5985167d00cccc8866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:03:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Creating volume 15ba7b9c-2e90-4357-b166-ae7f05434a9b {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:03:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:03:25 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:03:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-15ba7b9c-2e90-4357-b166-ae7f05434a9b 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:25 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-15ba7b9c-2e90-4357-b166-ae7f05434a9b 1073741824 Sep 28 16:03:25 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:25 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-15ba7b9c-2e90-4357-b166-ae7f05434a9b 1073741824" returned: 0 in 0.877s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Flow 'volume_create_manager' (a9ede428-f883-4b47-b304-8967ac601043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5fecab-1562-4d5f-8c5e-d028d1130224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-15ba7b9c-2e90-4357-b166-ae7f05434a9b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5fecab-1562-4d5f-8c5e-d028d1130224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-542744202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c50cf318-b002-468f-a536-4296d7891826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f457213c773243f8bcc515b1af883b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:26Z,use_quota=True,user_id='f5735ae8fe2b4363b115399feea2f536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3be8742-430c-48aa-8d4e-12a26fd47811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:26 devstack sudo[92485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-15ba7b9c-2e90-4357-b166-ae7f05434a9b Sep 28 16:03:26 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3be8742-430c-48aa-8d4e-12a26fd47811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740c8916-23af-4607-815a-cf90a5df7678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740c8916-23af-4607-815a-cf90a5df7678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c50cf318-b002-468f-a536-4296d7891826', 'volume_name': 'volume-c50cf318-b002-468f-a536-4296d7891826', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a299fe76-f848-493a-8274-b8a4138b23a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a299fe76-f848-493a-8274-b8a4138b23a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12dac03-e888-43ca-8569-ea016ae43bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:26 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Volume c50cf318-b002-468f-a536-4296d7891826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c50cf318-b002-468f-a536-4296d7891826', 'volume_size': 1} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:26 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-15ba7b9c-2e90-4357-b166-ae7f05434a9b" returned: 0 in 0.364s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.288s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-542744202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c50cf318-b002-468f-a536-4296d7891826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f457213c773243f8bcc515b1af883b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:26Z,use_quota=True,user_id='f5735ae8fe2b4363b115399feea2f536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Creating volume c50cf318-b002-468f-a536-4296d7891826 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:03:26 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c50cf318-b002-468f-a536-4296d7891826 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d136aa28-d74a-4a72-8f46-d5490ba33cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ba7b9c-2e90-4357-b166-ae7f05434a9b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:26 devstack sudo[92488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c50cf318-b002-468f-a536-4296d7891826 1073741824 Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01af04c8-f571-4996-a2be-0215b457609a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:26 devstack sudo[92488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:26 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Volume volume-15ba7b9c-2e90-4357-b166-ae7f05434a9b (15ba7b9c-2e90-4357-b166-ae7f05434a9b): created successfully Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01af04c8-f571-4996-a2be-0215b457609a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Flow 'volume_create_manager' (f5801fa8-5cd9-497d-8bf7-6eaabacd3611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9e42fb9b-73c8-40f4-9eaa-db1f72288d41 tempest-VolumesTestJSON-1972509314 None] Created volume successfully. Sep 28 16:03:27 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_q5audbkldevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d" returned: 0 in 2.856s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_q5audbkldevstack@QuobyteHD, size 112.00 MB, duration 2.86 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:03:27 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Converted 112.00 MB image at 39.19 MB/s Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:27 devstack sudo[92494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d 1G Sep 28 16:03:27 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:27 devstack sudo[92488]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c50cf318-b002-468f-a536-4296d7891826 1073741824" returned: 0 in 0.737s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c50cf318-b002-468f-a536-4296d7891826 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:27 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c50cf318-b002-468f-a536-4296d7891826 Sep 28 16:03:27 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:27 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c50cf318-b002-468f-a536-4296d7891826" returned: 0 in 0.382s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:27 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d 1G" returned: 0 in 0.528s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Downloaded image 7abc4afd-c71a-462f-b806-ba7da0f478cc ((None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}])) to volume be9ef84a-41b3-457c-a4cb-2ad8158c8e0d successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Temporary image 7abc4afd-c71a-462f-b806-ba7da0f478cc for user 1d4014feb3614e97b48ee8ff5f1544d7 is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Marking volume be9ef84a-41b3-457c-a4cb-2ad8158c8e0d as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12dac03-e888-43ca-8569-ea016ae43bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c50cf318-b002-468f-a536-4296d7891826', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea9b179-b082-4f5f-8904-ba1a2d2f2a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Copying metadata from image 7abc4afd-c71a-462f-b806-ba7da0f478cc to be9ef84a-41b3-457c-a4cb-2ad8158c8e0d. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Creating volume glance metadata for volume be9ef84a-41b3-457c-a4cb-2ad8158c8e0d backed by image 7abc4afd-c71a-462f-b806-ba7da0f478cc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:03:27 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Volume volume-c50cf318-b002-468f-a536-4296d7891826 (c50cf318-b002-468f-a536-4296d7891826): created successfully Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea9b179-b082-4f5f-8904-ba1a2d2f2a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Flow 'volume_create_manager' (a9ede428-f883-4b47-b304-8967ac601043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-43796a55-9dd1-422d-bf28-eca41d7a89c9 tempest-VolumesTransfersTest-1240122090 None] Created volume successfully. Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3988b06f-a1da-4aa3-9275-6fd582fa185d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d', 'volume_size': 1, 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3682e9714c0d4e0582fb2ca18f45f417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'created_at': datetime.datetime(2026, 9, 28, 13, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7abc4afd-c71a-462f-b806-ba7da0f478cc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07de343e-94ba-4855-b4e3-5a614a552e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:27 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Volume volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d (be9ef84a-41b3-457c-a4cb-2ad8158c8e0d): created successfully Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07de343e-94ba-4855-b4e3-5a614a552e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Flow 'volume_create_manager' (26090579-ae65-4785-aacf-4f6a1ecaf251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1aa4323d-50c3-49bf-bbef-5d34812e4dda tempest-ServerActionsTestOtherA-1617816428 None] Created volume successfully. Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Flow 'volume_create_manager' (368c56ae-2f95-48eb-9805-a999f4c1bf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea57e9e-14b4-4866-80c6-2b43dfa807fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea57e9e-14b4-4866-80c6-2b43dfa807fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1403184660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f842d240-e5de-47c9-a511-7b9636118db8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7146bf72b1fb4883b2ae1ac09aa61f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:28Z,use_quota=True,user_id='eb8a1747bfc14b5985167d00cccc8866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632e9397-5e61-4212-bafc-8e36ea675910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632e9397-5e61-4212-bafc-8e36ea675910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e9972d-d6e4-4add-8d2f-c99c78be4420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e9972d-d6e4-4add-8d2f-c99c78be4420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f842d240-e5de-47c9-a511-7b9636118db8', 'volume_name': 'volume-f842d240-e5de-47c9-a511-7b9636118db8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f090e4f-867c-4e67-8fd5-11f33f115973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f090e4f-867c-4e67-8fd5-11f33f115973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e70435-1969-4aaa-bda5-afff8a2bc080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:28 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Volume f842d240-e5de-47c9-a511-7b9636118db8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f842d240-e5de-47c9-a511-7b9636118db8', 'volume_size': 1} Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1403184660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f842d240-e5de-47c9-a511-7b9636118db8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7146bf72b1fb4883b2ae1ac09aa61f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:28Z,use_quota=True,user_id='eb8a1747bfc14b5985167d00cccc8866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Creating volume f842d240-e5de-47c9-a511-7b9636118db8 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:03:28 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f842d240-e5de-47c9-a511-7b9636118db8 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:28 devstack sudo[92503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f842d240-e5de-47c9-a511-7b9636118db8 1073741824 Sep 28 16:03:28 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:28 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f842d240-e5de-47c9-a511-7b9636118db8 1073741824" returned: 0 in 0.579s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f842d240-e5de-47c9-a511-7b9636118db8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:28 devstack sudo[92509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f842d240-e5de-47c9-a511-7b9636118db8 Sep 28 16:03:28 devstack sudo[92509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:28 devstack sudo[92509]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f842d240-e5de-47c9-a511-7b9636118db8" returned: 0 in 0.318s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:03:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e70435-1969-4aaa-bda5-afff8a2bc080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f842d240-e5de-47c9-a511-7b9636118db8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7142476a-27a1-4dc6-86f9-96abbedad855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0833da10-41f1-4fc4-8d1e-5e6fbbafe404 tempest-VolumesTransfersTest-1245918667 None] Transfer volume completed successfully. Sep 28 16:03:29 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Volume volume-f842d240-e5de-47c9-a511-7b9636118db8 (f842d240-e5de-47c9-a511-7b9636118db8): created successfully Sep 28 16:03:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7142476a-27a1-4dc6-86f9-96abbedad855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Flow 'volume_create_manager' (368c56ae-2f95-48eb-9805-a999f4c1bf8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a86c96d0-0828-44f9-8fba-872be7a43b29 tempest-VolumesTestJSON-1972509314 None] Created volume successfully. Sep 28 16:03:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] Acquiring lock "cinder-c50cf318-b002-468f-a536-4296d7891826-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] Lock "cinder-c50cf318-b002-468f-a536-4296d7891826-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] Acquiring lock "cinder-quobyte-c50cf318-b002-468f-a536-4296d7891826" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] Lock "cinder-quobyte-c50cf318-b002-468f-a536-4296d7891826" acquired by "delete_volume" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:29 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0856d4-220f-432a-a5f7-1b395eecd709]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c50cf318-b002-468f-a536-4296d7891826 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:30 devstack sudo[92515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c50cf318-b002-468f-a536-4296d7891826 Sep 28 16:03:30 devstack sudo[92515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:30 devstack sudo[92515]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c50cf318-b002-468f-a536-4296d7891826" returned: 0 in 0.543s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c50cf318-b002-468f-a536-4296d7891826 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:30 devstack sudo[92521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c50cf318-b002-468f-a536-4296d7891826 Sep 28 16:03:30 devstack sudo[92521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:30 devstack sudo[92521]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:30 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:03:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Flow 'volume_create_manager' (947ac8b1-e205-4c19-aec4-2fbfe4ea4d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88640543-0d38-46c0-bcb5-42b0fa752605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c50cf318-b002-468f-a536-4296d7891826" returned: 0 in 0.355s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] Lock "cinder-quobyte-c50cf318-b002-468f-a536-4296d7891826" released by "delete_volume" :: held 0.987s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88640543-0d38-46c0-bcb5-42b0fa752605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-471284666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=250c944d-3ed0-488f-8cd3-de02a3a49cf0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7146bf72b1fb4883b2ae1ac09aa61f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:31Z,use_quota=True,user_id='eb8a1747bfc14b5985167d00cccc8866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf652ddf-9b98-4cab-ab33-99cdec1d0812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf652ddf-9b98-4cab-ab33-99cdec1d0812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987a7c60-baaa-4b5c-9682-5a7a618e7f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987a7c60-baaa-4b5c-9682-5a7a618e7f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '250c944d-3ed0-488f-8cd3-de02a3a49cf0', 'volume_name': 'volume-250c944d-3ed0-488f-8cd3-de02a3a49cf0', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80399c45-abb2-447f-a37d-68e9f62fec4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80399c45-abb2-447f-a37d-68e9f62fec4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f8290f-54ab-44f1-9753-1c156c0c3dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:31 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Volume 250c944d-3ed0-488f-8cd3-de02a3a49cf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-250c944d-3ed0-488f-8cd3-de02a3a49cf0', 'volume_size': 1} Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-471284666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=250c944d-3ed0-488f-8cd3-de02a3a49cf0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7146bf72b1fb4883b2ae1ac09aa61f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:31Z,use_quota=True,user_id='eb8a1747bfc14b5985167d00cccc8866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Creating volume 250c944d-3ed0-488f-8cd3-de02a3a49cf0 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:03:31 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-250c944d-3ed0-488f-8cd3-de02a3a49cf0 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:31 devstack sudo[92526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-250c944d-3ed0-488f-8cd3-de02a3a49cf0 1073741824 Sep 28 16:03:31 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] Created reservations ['9a882e5f-ab23-4143-8b8e-40da001983cb', '0852c7e1-10a3-46b2-b036-5e247a29484a', '28404ef5-f138-48be-9f0f-ac48d2f8dd83', '9efc544a-b841-46a0-b637-d8a55d11e778'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:31 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:03:31 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:31 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.374s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:03:31 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] Deleted volume successfully. Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2952c120-b61a-457d-a8c6-e81ad22f8b2c tempest-VolumesTransfersTest-2045299696 None] Lock "cinder-c50cf318-b002-468f-a536-4296d7891826-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:31 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-250c944d-3ed0-488f-8cd3-de02a3a49cf0 1073741824" returned: 0 in 0.735s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-250c944d-3ed0-488f-8cd3-de02a3a49cf0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:31 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-250c944d-3ed0-488f-8cd3-de02a3a49cf0 Sep 28 16:03:31 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-ba030efc-1004-4687-a08a-f0f52ef8fd32 req-62a4a8e7-d4c7-41fb-92b0-c229914b3cdf tempest-ServerActionsTestOtherA-1617816428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Flow 'volume_create_manager' (3642fa0e-20dc-4868-8e8c-af0259b00725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1603e9b-8b92-4259-a8d0-d2db8870d7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1603e9b-8b92-4259-a8d0-d2db8870d7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-912007139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8628170-2ce0-4586-a0ab-54e35c660b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d9f246933d489f9931da8f163e8e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:32Z,use_quota=True,user_id='0c933cfb6e12446eb5db6474824cd49f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d04402d-6049-4d36-afc8-33039b8110ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d04402d-6049-4d36-afc8-33039b8110ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161f5602-d95d-4db7-9b8b-4dfe63ba3de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161f5602-d95d-4db7-9b8b-4dfe63ba3de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8628170-2ce0-4586-a0ab-54e35c660b50', 'volume_name': 'volume-e8628170-2ce0-4586-a0ab-54e35c660b50', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b87c3a-6fde-413c-9b54-5ecb9098c11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b87c3a-6fde-413c-9b54-5ecb9098c11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09bff64f-e2a9-4f3e-a25e-3c14f03b6174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:32 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Volume e8628170-2ce0-4586-a0ab-54e35c660b50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8628170-2ce0-4586-a0ab-54e35c660b50', 'volume_size': 1} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:32 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-250c944d-3ed0-488f-8cd3-de02a3a49cf0" returned: 0 in 0.391s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-ba030efc-1004-4687-a08a-f0f52ef8fd32 req-62a4a8e7-d4c7-41fb-92b0-c229914b3cdf tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.196s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f8290f-54ab-44f1-9753-1c156c0c3dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-250c944d-3ed0-488f-8cd3-de02a3a49cf0', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbb722e-a51a-4299-b13e-86534388d64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-ba030efc-1004-4687-a08a-f0f52ef8fd32 req-62a4a8e7-d4c7-41fb-92b0-c229914b3cdf tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.089s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-912007139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8628170-2ce0-4586-a0ab-54e35c660b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d9f246933d489f9931da8f163e8e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:32Z,use_quota=True,user_id='0c933cfb6e12446eb5db6474824cd49f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Creating volume e8628170-2ce0-4586-a0ab-54e35c660b50 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:03:32 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e8628170-2ce0-4586-a0ab-54e35c660b50 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:32 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Volume volume-250c944d-3ed0-488f-8cd3-de02a3a49cf0 (250c944d-3ed0-488f-8cd3-de02a3a49cf0): created successfully Sep 28 16:03:32 devstack sudo[92546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e8628170-2ce0-4586-a0ab-54e35c660b50 1073741824 Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbb722e-a51a-4299-b13e-86534388d64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:32 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Flow 'volume_create_manager' (947ac8b1-e205-4c19-aec4-2fbfe4ea4d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:32 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-684f081f-4830-4119-9b97-626867f7d9fa tempest-VolumesTestJSON-1972509314 None] Created volume successfully. Sep 28 16:03:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-ba030efc-1004-4687-a08a-f0f52ef8fd32 req-62a4a8e7-d4c7-41fb-92b0-c229914b3cdf tempest-ServerActionsTestOtherA-1617816428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3d3781f-d92e-4102-8572-4607837ddf84', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:03:32 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-ba030efc-1004-4687-a08a-f0f52ef8fd32 req-62a4a8e7-d4c7-41fb-92b0-c229914b3cdf tempest-ServerActionsTestOtherA-1617816428 None] attachment_update completed successfully. Sep 28 16:03:33 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e8628170-2ce0-4586-a0ab-54e35c660b50 1073741824" returned: 0 in 0.884s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e8628170-2ce0-4586-a0ab-54e35c660b50 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:33 devstack sudo[92552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e8628170-2ce0-4586-a0ab-54e35c660b50 Sep 28 16:03:33 devstack sudo[92552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Flow 'volume_create_manager' (9dd61543-84f9-4bed-9cb9-099ef9539890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b31e575-e7e1-4075-8064-f67ef9250d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b31e575-e7e1-4075-8064-f67ef9250d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-222630988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad947e3-b679-404f-bb60-02bffb4fa33b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f457213c773243f8bcc515b1af883b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:33Z,use_quota=True,user_id='f5735ae8fe2b4363b115399feea2f536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa26ba3b-c842-41e1-8d40-d7a699b49b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa26ba3b-c842-41e1-8d40-d7a699b49b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9c7282-00ae-4990-8783-c16cff3f6e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9c7282-00ae-4990-8783-c16cff3f6e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ad947e3-b679-404f-bb60-02bffb4fa33b', 'volume_name': 'volume-9ad947e3-b679-404f-bb60-02bffb4fa33b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db19681-6164-487d-9eff-aaa4adfff1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db19681-6164-487d-9eff-aaa4adfff1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dce3278-793b-4cd7-bf70-ba68d5c9cca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:33 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Volume 9ad947e3-b679-404f-bb60-02bffb4fa33b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ad947e3-b679-404f-bb60-02bffb4fa33b', 'volume_size': 1} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:33 devstack sudo[92552]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e8628170-2ce0-4586-a0ab-54e35c660b50" returned: 0 in 0.340s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.122s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-222630988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad947e3-b679-404f-bb60-02bffb4fa33b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f457213c773243f8bcc515b1af883b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:33Z,use_quota=True,user_id='f5735ae8fe2b4363b115399feea2f536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Creating volume 9ad947e3-b679-404f-bb60-02bffb4fa33b {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:03:33 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9ad947e3-b679-404f-bb60-02bffb4fa33b 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09bff64f-e2a9-4f3e-a25e-3c14f03b6174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8628170-2ce0-4586-a0ab-54e35c660b50', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:33 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9ad947e3-b679-404f-bb60-02bffb4fa33b 1073741824 Sep 28 16:03:33 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1cc440-4de8-4ce2-9a21-5828bd6f2162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:33 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Volume volume-e8628170-2ce0-4586-a0ab-54e35c660b50 (e8628170-2ce0-4586-a0ab-54e35c660b50): created successfully Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1cc440-4de8-4ce2-9a21-5828bd6f2162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Flow 'volume_create_manager' (3642fa0e-20dc-4868-8e8c-af0259b00725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e8054866-1ee5-4377-a6be-4a79391a18c7 tempest-AttachVolumeShelveTestJSON-1788737434 None] Created volume successfully. Sep 28 16:03:34 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9ad947e3-b679-404f-bb60-02bffb4fa33b 1073741824" returned: 0 in 0.651s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9ad947e3-b679-404f-bb60-02bffb4fa33b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:34 devstack sudo[92565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9ad947e3-b679-404f-bb60-02bffb4fa33b Sep 28 16:03:34 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] Acquiring lock "cinder-250c944d-3ed0-488f-8cd3-de02a3a49cf0-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] Lock "cinder-250c944d-3ed0-488f-8cd3-de02a3a49cf0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] Acquiring lock "cinder-quobyte-250c944d-3ed0-488f-8cd3-de02a3a49cf0" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] Lock "cinder-quobyte-250c944d-3ed0-488f-8cd3-de02a3a49cf0" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:34 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1e3024-9be6-44ec-933b-d02b8beeec3c]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-250c944d-3ed0-488f-8cd3-de02a3a49cf0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:34 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9ad947e3-b679-404f-bb60-02bffb4fa33b" returned: 0 in 0.477s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:03:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:34 devstack sudo[92568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-250c944d-3ed0-488f-8cd3-de02a3a49cf0 Sep 28 16:03:34 devstack sudo[92568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dce3278-793b-4cd7-bf70-ba68d5c9cca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ad947e3-b679-404f-bb60-02bffb4fa33b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956a5d8a-3ee2-4a9b-9c4c-9d1cdcd82608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:34 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Volume volume-9ad947e3-b679-404f-bb60-02bffb4fa33b (9ad947e3-b679-404f-bb60-02bffb4fa33b): created successfully Sep 28 16:03:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956a5d8a-3ee2-4a9b-9c4c-9d1cdcd82608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Flow 'volume_create_manager' (9dd61543-84f9-4bed-9cb9-099ef9539890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:34 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a538e906-7f27-491b-88d7-3b6b2168911e tempest-VolumesTransfersTest-1240122090 None] Created volume successfully. Sep 28 16:03:34 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:03:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:35 devstack sudo[92572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:03:35 devstack sudo[92572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:35 devstack sudo[92568]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-250c944d-3ed0-488f-8cd3-de02a3a49cf0" returned: 0 in 0.702s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-250c944d-3ed0-488f-8cd3-de02a3a49cf0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:35 devstack sudo[92578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-250c944d-3ed0-488f-8cd3-de02a3a49cf0 Sep 28 16:03:35 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:35 devstack sudo[92572]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.477s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:03:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:03:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:03:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:03:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] Acquiring lock "cinder-9ad947e3-b679-404f-bb60-02bffb4fa33b-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] Lock "cinder-9ad947e3-b679-404f-bb60-02bffb4fa33b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] Acquiring lock "cinder-quobyte-9ad947e3-b679-404f-bb60-02bffb4fa33b" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:35 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-250c944d-3ed0-488f-8cd3-de02a3a49cf0" returned: 0 in 0.550s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] Lock "cinder-quobyte-9ad947e3-b679-404f-bb60-02bffb4fa33b" acquired by "delete_volume" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] Lock "cinder-quobyte-250c944d-3ed0-488f-8cd3-de02a3a49cf0" released by "delete_volume" :: held 1.361s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:35 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e542679-7d96-4b3e-bdbf-41974bacb39f]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9ad947e3-b679-404f-bb60-02bffb4fa33b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:36 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] Created reservations ['242d240f-8dad-441d-bb5c-531ae2681752', '88d78397-7098-4fb5-a5d3-4a53c1214489', '71fb73a4-d4af-4147-a0d0-01f855404631', '4d3825c4-167f-4e0e-bef0-badff9c84492'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:03:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:36 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9ad947e3-b679-404f-bb60-02bffb4fa33b Sep 28 16:03:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:36 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:36 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:03:36 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:36 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9ad947e3-b679-404f-bb60-02bffb4fa33b" returned: 0 in 0.995s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9ad947e3-b679-404f-bb60-02bffb4fa33b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] Acquiring lock "cinder-f842d240-e5de-47c9-a511-7b9636118db8-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:36 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9ad947e3-b679-404f-bb60-02bffb4fa33b Sep 28 16:03:36 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:37 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.800s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:03:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] Deleted volume successfully. Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] Lock "cinder-f842d240-e5de-47c9-a511-7b9636118db8-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2909ced1-2934-43a0-aecd-1a34c66b9918 tempest-VolumesTestJSON-1972509314 None] Lock "cinder-250c944d-3ed0-488f-8cd3-de02a3a49cf0-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] Acquiring lock "cinder-quobyte-f842d240-e5de-47c9-a511-7b9636118db8" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] Lock "cinder-quobyte-f842d240-e5de-47c9-a511-7b9636118db8" acquired by "delete_volume" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[79917ee8-574e-4bf9-b6b0-650d4f31b380]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f842d240-e5de-47c9-a511-7b9636118db8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:37 devstack sudo[93033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f842d240-e5de-47c9-a511-7b9636118db8 Sep 28 16:03:37 devstack sudo[93033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:37 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9ad947e3-b679-404f-bb60-02bffb4fa33b" returned: 0 in 0.448s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] Lock "cinder-quobyte-9ad947e3-b679-404f-bb60-02bffb4fa33b" released by "delete_volume" :: held 1.530s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] Created reservations ['c45c5a83-3ed1-4478-a7c0-23ba18ba5b08', '547bb53e-7aee-4699-b4c0-c0286ea8282e', 'a330f2d8-26c1-4f80-88d6-b7568db9c004', 'f1df1263-714a-49f6-8332-3f756699ae14'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:37 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:03:37 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:37 devstack sudo[93033]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f842d240-e5de-47c9-a511-7b9636118db8" returned: 0 in 0.525s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f842d240-e5de-47c9-a511-7b9636118db8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:37 devstack sudo[93052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f842d240-e5de-47c9-a511-7b9636118db8 Sep 28 16:03:37 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:37 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.328s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:03:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] Deleted volume successfully. Sep 28 16:03:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a871cb86-6d4b-45c0-b1c5-7570f036fffc tempest-VolumesTransfersTest-2045299696 None] Lock "cinder-9ad947e3-b679-404f-bb60-02bffb4fa33b-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:38 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f842d240-e5de-47c9-a511-7b9636118db8" returned: 0 in 0.378s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] Lock "cinder-quobyte-f842d240-e5de-47c9-a511-7b9636118db8" released by "delete_volume" :: held 0.967s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:38 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] Created reservations ['bf5b091d-9c5a-4df2-8a7d-dcdb8a3ca0d0', 'e9269571-1065-47bb-8bb7-6914f36d9ad9', '8bbc75b0-d611-4780-ae5b-9102677a64e7', '2ebd87aa-5925-4d16-9395-56db7deb7512'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:03:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:38 devstack sudo[93071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:03:38 devstack sudo[93071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:38 devstack sudo[93071]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.462s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:38 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:03:38 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] Deleted volume successfully. Sep 28 16:03:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ee3b3dee-c9b1-412f-a19d-71bd5f742c54 tempest-VolumesTestJSON-1972509314 None] Lock "cinder-f842d240-e5de-47c9-a511-7b9636118db8-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] Acquiring lock "cinder-15ba7b9c-2e90-4357-b166-ae7f05434a9b-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] Lock "cinder-15ba7b9c-2e90-4357-b166-ae7f05434a9b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] Acquiring lock "cinder-quobyte-15ba7b9c-2e90-4357-b166-ae7f05434a9b" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] Lock "cinder-quobyte-15ba7b9c-2e90-4357-b166-ae7f05434a9b" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:39 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea64917-1dc2-464c-8f45-b10ae50a0369]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-15ba7b9c-2e90-4357-b166-ae7f05434a9b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:39 devstack sudo[93092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-15ba7b9c-2e90-4357-b166-ae7f05434a9b Sep 28 16:03:39 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:40 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-15ba7b9c-2e90-4357-b166-ae7f05434a9b" returned: 0 in 0.785s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-15ba7b9c-2e90-4357-b166-ae7f05434a9b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:40 devstack sudo[93100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-15ba7b9c-2e90-4357-b166-ae7f05434a9b Sep 28 16:03:40 devstack sudo[93100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:40 devstack sudo[93100]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-15ba7b9c-2e90-4357-b166-ae7f05434a9b" returned: 0 in 0.482s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] Lock "cinder-quobyte-15ba7b9c-2e90-4357-b166-ae7f05434a9b" released by "delete_volume" :: held 1.346s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:41 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] Created reservations ['9808256e-ed62-4d45-8191-9b7991b1bc26', '66f48212-c104-4fda-8e0e-c2de58936579', '54ace90a-faae-4292-b62b-ad46ca9a3e14', 'b9a1bbd5-a3dd-42a8-b771-a3f6416cf1a9'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:03:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:41 devstack sudo[93103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:03:41 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:41 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.562s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:41 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:03:41 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] Deleted volume successfully. Sep 28 16:03:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-33d1469e-ce9e-4b87-8f20-6ff5dff35449 tempest-VolumesTestJSON-1972509314 None] Lock "cinder-15ba7b9c-2e90-4357-b166-ae7f05434a9b-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:51 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=71,cinder:INSERT=31,cinder:UPDATE=81,cinder:DELETE=9 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:03:51 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=72,cinder:INSERT=30,cinder:UPDATE=88,cinder:DELETE=7 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:03:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-f94e7f0f-e905-4c00-8f9a-07b1256a274a req-22f42429-e6ff-442b-8913-9c3f3d82a501 tempest-AttachVolumeShelveTestJSON-1788737434 None] No connector for attachment afa8b975-1de5-4d7b-9e34-aa5a1a37e58e; skipping storage backend terminate_connection call. {{(pid=87087) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 16:03:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-f94e7f0f-e905-4c00-8f9a-07b1256a274a req-22f42429-e6ff-442b-8913-9c3f3d82a501 tempest-AttachVolumeShelveTestJSON-1788737434 None] Deleting attachment afa8b975-1de5-4d7b-9e34-aa5a1a37e58e. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:03:56 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:03:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Flow 'volume_create_manager' (cbf5f99e-daa7-45fa-ae15-4b00b34909be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8bdf3f8-b3ed-40f8-86a9-b8bbcf70ede7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8bdf3f8-b3ed-40f8-86a9-b8bbcf70ede7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-21290251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed13fee0-d90e-4109-a512-8d63335eefd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd02f9b01f45411c8b8bc7338d357cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:57Z,use_quota=True,user_id='4b81ea34e5d04332bd9d526f5c752304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db385a6f-2eec-403f-8c7b-9117ee86a7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db385a6f-2eec-403f-8c7b-9117ee86a7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345a20b5-9ce9-404b-9aa0-b4e6fcb57bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345a20b5-9ce9-404b-9aa0-b4e6fcb57bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed13fee0-d90e-4109-a512-8d63335eefd8', 'volume_name': 'volume-ed13fee0-d90e-4109-a512-8d63335eefd8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4b4996-f8ed-4564-ad9f-20d3337f525d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4b4996-f8ed-4564-ad9f-20d3337f525d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb88eaa-3bc3-41b6-9ef6-035b920a82d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:57 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Volume ed13fee0-d90e-4109-a512-8d63335eefd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed13fee0-d90e-4109-a512-8d63335eefd8', 'volume_size': 1} Sep 28 16:03:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-21290251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed13fee0-d90e-4109-a512-8d63335eefd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd02f9b01f45411c8b8bc7338d357cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:57Z,use_quota=True,user_id='4b81ea34e5d04332bd9d526f5c752304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:03:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Creating volume ed13fee0-d90e-4109-a512-8d63335eefd8 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:03:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:03:57 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:03:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:57 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8 1073741824 Sep 28 16:03:57 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-fb065538-c013-41df-8313-71efc4c7578a req-8b7dcf9f-16e4-4e4b-84ec-a69d97866403 tempest-ServerActionsTestOtherA-1617816428 None] Terminate volume connection completed successfully. Sep 28 16:03:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-fb065538-c013-41df-8313-71efc4c7578a req-8b7dcf9f-16e4-4e4b-84ec-a69d97866403 tempest-ServerActionsTestOtherA-1617816428 None] Deleting attachment b3d3781f-d92e-4102-8572-4607837ddf84. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:03:57 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8 1073741824" returned: 0 in 0.777s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:57 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8 Sep 28 16:03:57 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:58 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8" returned: 0 in 0.541s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:03:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb88eaa-3bc3-41b6-9ef6-035b920a82d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed13fee0-d90e-4109-a512-8d63335eefd8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a7fcaf-c2b3-48e6-80d9-da781fd49e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:58 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Volume volume-ed13fee0-d90e-4109-a512-8d63335eefd8 (ed13fee0-d90e-4109-a512-8d63335eefd8): created successfully Sep 28 16:03:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a7fcaf-c2b3-48e6-80d9-da781fd49e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Flow 'volume_create_manager' (cbf5f99e-daa7-45fa-ae15-4b00b34909be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-254e7b4b-982a-47a1-aa02-e06ba1c8255c tempest-VolumesCloneTest-170818781 None] Created volume successfully. Sep 28 16:03:59 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:03:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Flow 'volume_create_manager' (cede5112-2826-4fd3-81fd-6394936508c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d810b4b6-e52c-4590-9cfa-6538debd49b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d810b4b6-e52c-4590-9cfa-6538debd49b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2041733515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1752a18-2363-42a2-8dc0-1ce3ad096875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd02f9b01f45411c8b8bc7338d357cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=ed13fee0-d90e-4109-a512-8d63335eefd8,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:00Z,use_quota=True,user_id='4b81ea34e5d04332bd9d526f5c752304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad401de6-a8ec-4349-b5f2-fa4cd7aa14e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad401de6-a8ec-4349-b5f2-fa4cd7aa14e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1e1d8e-26da-42a5-bf17-1145eb03f711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1e1d8e-26da-42a5-bf17-1145eb03f711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e1752a18-2363-42a2-8dc0-1ce3ad096875', 'volume_name': 'volume-e1752a18-2363-42a2-8dc0-1ce3ad096875', 'volume_size': 2, 'source_volid': 'ed13fee0-d90e-4109-a512-8d63335eefd8', 'source_volstatus': 'available'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bacc885-4e6d-44f9-a5c3-01c20a8a3438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bacc885-4e6d-44f9-a5c3-01c20a8a3438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3327a3b-a128-4ffd-9718-098e340b1aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:59 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Volume e1752a18-2363-42a2-8dc0-1ce3ad096875: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e1752a18-2363-42a2-8dc0-1ce3ad096875', 'volume_size': 2, 'source_volid': 'ed13fee0-d90e-4109-a512-8d63335eefd8', 'source_volstatus': 'available'} Sep 28 16:03:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:59 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Cloning volume ed13fee0-d90e-4109-a512-8d63335eefd8 to volume e1752a18-2363-42a2-8dc0-1ce3ad096875 Sep 28 16:03:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Creating offline snapshot be173fff-9f53-4cb1-9994-17d37e163863 of volume ed13fee0-d90e-4109-a512-8d63335eefd8 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:03:59 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b35c2d2-a32b-4882-9bb5-0b6bd77cd8dd]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-fb065538-c013-41df-8313-71efc4c7578a req-6d8c2b8e-3f68-4831-b8fa-ee7cd995435a tempest-ServerActionsTestOtherA-1617816428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:00 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8 Sep 28 16:04:00 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:00 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8" returned: 0 in 0.632s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:00 devstack sudo[93218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863 1G Sep 28 16:04:00 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:01 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863 1G" returned: 0 in 0.569s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed13fee0-d90e-4109-a512-8d63335eefd8 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:01 devstack sudo[93223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed13fee0-d90e-4109-a512-8d63335eefd8 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863 Sep 28 16:04:01 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:01 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed13fee0-d90e-4109-a512-8d63335eefd8 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863" returned: 0 in 0.451s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:01 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863 is being set with open permissions: ugo+rw Sep 28 16:04:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:01 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863 Sep 28 16:04:01 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:01 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863" returned: 0 in 0.434s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:02 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.info Sep 28 16:04:02 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:02 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.info" returned: 0 in 0.358s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:02 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.info is being set with open permissions: ugo+rw Sep 28 16:04:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:02 devstack sudo[93236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.info Sep 28 16:04:02 devstack sudo[93236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:02 devstack sudo[93236]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.info" returned: 0 in 0.335s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Acquiring lock "cinder-quobyte-e1752a18-2363-42a2-8dc0-1ce3ad096875" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Lock "cinder-quobyte-e1752a18-2363-42a2-8dc0-1ce3ad096875" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] snapshot: be173fff-9f53-4cb1-9994-17d37e163863, volume: e1752a18-2363-42a2-8dc0-1ce3ad096875, {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:04:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:02 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[043f3fe0-536e-45aa-84eb-435435cab446]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:03 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863 Sep 28 16:04:03 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:03 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863" returned: 0 in 0.747s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed13fee0-d90e-4109-a512-8d63335eefd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:04:03 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f0979c-c860-42ec-87ad-5b833e561284]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:03 devstack sudo[93244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8 Sep 28 16:04:03 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:04 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8" returned: 0 in 0.513s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8 {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:04:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:04:04 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Path /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e1752a18-2363-42a2-8dc0-1ce3ad096875 not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:04:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e1752a18-2363-42a2-8dc0-1ce3ad096875 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:04 devstack sudo[93249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e1752a18-2363-42a2-8dc0-1ce3ad096875 Sep 28 16:04:04 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:06 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:04:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Flow 'volume_create_manager' (83baf02d-06c1-429a-aa55-c709b50e41a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f83a316-54bf-455d-88be-cbce3fbf7d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f83a316-54bf-455d-88be-cbce3fbf7d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2079151353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ebdf2ff-7e97-48ea-a36f-0b16001951ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5410455e6b474ab21dfc9bc4b26fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:07Z,use_quota=True,user_id='963d8515f3ce46649930eccd9a8a8389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b81ef1-58af-4ed7-a6d7-7fd96a2a2590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b81ef1-58af-4ed7-a6d7-7fd96a2a2590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb9e461-81eb-41e5-b0b8-34d6e2085ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb9e461-81eb-41e5-b0b8-34d6e2085ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ebdf2ff-7e97-48ea-a36f-0b16001951ce', 'volume_name': 'volume-8ebdf2ff-7e97-48ea-a36f-0b16001951ce', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8621eec-4143-4a43-b361-566f9e69497b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8621eec-4143-4a43-b361-566f9e69497b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa274dfb-1e04-4513-863f-34dcfb215d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:07 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Volume 8ebdf2ff-7e97-48ea-a36f-0b16001951ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ebdf2ff-7e97-48ea-a36f-0b16001951ce', 'volume_size': 1} Sep 28 16:04:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:14 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e1752a18-2363-42a2-8dc0-1ce3ad096875" returned: 0 in 9.927s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:14 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8, size 1024.00 MB, duration 9.93 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e1752a18-2363-42a2-8dc0-1ce3ad096875 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:04:14 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Converted 1024.00 MB image at 103.15 MB/s Sep 28 16:04:14 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e1752a18-2363-42a2-8dc0-1ce3ad096875 is being set with open permissions: ugo+rw Sep 28 16:04:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e1752a18-2363-42a2-8dc0-1ce3ad096875 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:14 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e1752a18-2363-42a2-8dc0-1ce3ad096875 Sep 28 16:04:14 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:14 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e1752a18-2363-42a2-8dc0-1ce3ad096875" returned: 0 in 0.364s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Lock "cinder-quobyte-e1752a18-2363-42a2-8dc0-1ce3ad096875" released by "_copy_volume_from_snapshot" :: held 11.664s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Acquiring lock "cinder-quobyte-be173fff-9f53-4cb1-9994-17d37e163863" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Lock "cinder-quobyte-be173fff-9f53-4cb1-9994-17d37e163863" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Deleting offline snapshot be173fff-9f53-4cb1-9994-17d37e163863 of volume ed13fee0-d90e-4109-a512-8d63335eefd8 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:04:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] snapshot_file for this snap is: volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:04:14 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fc4b35-2735-4cb0-901b-873814809803]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:14 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863 Sep 28 16:04:14 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:15 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863" returned: 0 in 0.461s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed13fee0-d90e-4109-a512-8d63335eefd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:04:15 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa8d3a3-b3bc-4135-96b2-ad161de032c4]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:15 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8 Sep 28 16:04:15 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:15 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8" returned: 0 in 0.832s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:15 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863 Sep 28 16:04:15 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:16 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863" returned: 0 in 0.464s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:16 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863 Sep 28 16:04:16 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:16 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8.be173fff-9f53-4cb1-9994-17d37e163863" returned: 0 in 0.334s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Lock "cinder-quobyte-be173fff-9f53-4cb1-9994-17d37e163863" released by "_delete_snapshot" :: held 2.241s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.957s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-fb065538-c013-41df-8313-71efc4c7578a req-6d8c2b8e-3f68-4831-b8fa-ee7cd995435a tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 16.802s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-fb065538-c013-41df-8313-71efc4c7578a req-6d8c2b8e-3f68-4831-b8fa-ee7cd995435a tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.832s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2079151353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ebdf2ff-7e97-48ea-a36f-0b16001951ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5410455e6b474ab21dfc9bc4b26fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:07Z,use_quota=True,user_id='963d8515f3ce46649930eccd9a8a8389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Creating volume 8ebdf2ff-7e97-48ea-a36f-0b16001951ce {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:04:16 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8ebdf2ff-7e97-48ea-a36f-0b16001951ce 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3327a3b-a128-4ffd-9718-098e340b1aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1752a18-2363-42a2-8dc0-1ce3ad096875', 'volume_size': 2, 'source_volid': 'ed13fee0-d90e-4109-a512-8d63335eefd8', 'source_volstatus': 'available'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903f1466-ea4b-4dd9-8d09-509d8a9ebb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:16 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8ebdf2ff-7e97-48ea-a36f-0b16001951ce 1073741824 Sep 28 16:04:16 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:16 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Volume volume-e1752a18-2363-42a2-8dc0-1ce3ad096875 (e1752a18-2363-42a2-8dc0-1ce3ad096875): created successfully Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903f1466-ea4b-4dd9-8d09-509d8a9ebb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Flow 'volume_create_manager' (cede5112-2826-4fd3-81fd-6394936508c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:16 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b73bca39-ed08-408b-93be-8916bd5fe1ec tempest-VolumesCloneTest-170818781 None] Created volume successfully. Sep 28 16:04:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-fb065538-c013-41df-8313-71efc4c7578a req-6d8c2b8e-3f68-4831-b8fa-ee7cd995435a tempest-ServerActionsTestOtherA-1617816428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '499adaf5-787b-44f8-a726-7447c5ea3f73', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:04:17 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-fb065538-c013-41df-8313-71efc4c7578a req-6d8c2b8e-3f68-4831-b8fa-ee7cd995435a tempest-ServerActionsTestOtherA-1617816428 None] attachment_update completed successfully. Sep 28 16:04:17 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8ebdf2ff-7e97-48ea-a36f-0b16001951ce 1073741824" returned: 0 in 0.790s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8ebdf2ff-7e97-48ea-a36f-0b16001951ce {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:17 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8ebdf2ff-7e97-48ea-a36f-0b16001951ce Sep 28 16:04:17 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:18 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8ebdf2ff-7e97-48ea-a36f-0b16001951ce" returned: 0 in 0.762s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:04:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa274dfb-1e04-4513-863f-34dcfb215d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ebdf2ff-7e97-48ea-a36f-0b16001951ce', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8bb4c69-246c-4205-b4d1-5551cdcba491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:18 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Volume volume-8ebdf2ff-7e97-48ea-a36f-0b16001951ce (8ebdf2ff-7e97-48ea-a36f-0b16001951ce): created successfully Sep 28 16:04:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8bb4c69-246c-4205-b4d1-5551cdcba491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Flow 'volume_create_manager' (83baf02d-06c1-429a-aa55-c709b50e41a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:18 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6d067fe3-cda3-4bae-84bf-0837ed1edc5f tempest-VolumeQuotasAdminTestJSON-1555210397 None] Created volume successfully. Sep 28 16:04:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] Acquiring lock "cinder-e1752a18-2363-42a2-8dc0-1ce3ad096875-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] Lock "cinder-e1752a18-2363-42a2-8dc0-1ce3ad096875-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] Acquiring lock "cinder-quobyte-e1752a18-2363-42a2-8dc0-1ce3ad096875" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] Lock "cinder-quobyte-e1752a18-2363-42a2-8dc0-1ce3ad096875" acquired by "delete_volume" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:19 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe339043-14db-4677-9bf9-5d50469cb327]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e1752a18-2363-42a2-8dc0-1ce3ad096875 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:19 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e1752a18-2363-42a2-8dc0-1ce3ad096875 Sep 28 16:04:19 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Acquiring lock "cinder-8ebdf2ff-7e97-48ea-a36f-0b16001951ce-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Lock "cinder-8ebdf2ff-7e97-48ea-a36f-0b16001951ce-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Acquiring lock "cinder-quobyte-8ebdf2ff-7e97-48ea-a36f-0b16001951ce" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Lock "cinder-quobyte-8ebdf2ff-7e97-48ea-a36f-0b16001951ce" acquired by "delete_volume" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:19 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c3ed2d-ba51-4cce-97f4-3ebf16d9137e]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8ebdf2ff-7e97-48ea-a36f-0b16001951ce {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:19 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e1752a18-2363-42a2-8dc0-1ce3ad096875" returned: 0 in 0.841s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e1752a18-2363-42a2-8dc0-1ce3ad096875 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:19 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e1752a18-2363-42a2-8dc0-1ce3ad096875 Sep 28 16:04:19 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:20 devstack sudo[93927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8ebdf2ff-7e97-48ea-a36f-0b16001951ce Sep 28 16:04:20 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:20 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e1752a18-2363-42a2-8dc0-1ce3ad096875" returned: 0 in 0.376s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] Lock "cinder-quobyte-e1752a18-2363-42a2-8dc0-1ce3ad096875" released by "delete_volume" :: held 1.298s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:20 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8ebdf2ff-7e97-48ea-a36f-0b16001951ce" returned: 0 in 0.518s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8ebdf2ff-7e97-48ea-a36f-0b16001951ce {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:20 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] Created reservations ['c4335a0d-654c-4116-9b6a-cba8ca72c7e9', '7b32588f-72e7-421f-8353-9ffe351a579d', 'fda50059-9f70-495c-ac40-536ea4ab3ea0', '794d7eb3-5053-43df-a74c-941d94b67117'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:20 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8ebdf2ff-7e97-48ea-a36f-0b16001951ce Sep 28 16:04:20 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:20 devstack sudo[93950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:04:20 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:20 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8ebdf2ff-7e97-48ea-a36f-0b16001951ce" returned: 0 in 0.431s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Lock "cinder-quobyte-8ebdf2ff-7e97-48ea-a36f-0b16001951ce" released by "delete_volume" :: held 1.031s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:20 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Created reservations ['238fb660-3456-4f1e-b9cc-73fbeb038107', '0944b44d-5d65-497f-98f6-919991e1a96a', '8cb5a372-1605-4909-be40-bb1899036332', '69e39f97-40e4-4015-8517-0d70462a0513'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:21 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.400s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:21 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] Deleted volume successfully. Sep 28 16:04:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-01db3658-3798-45c1-8b6a-ade0f37b35f5 tempest-VolumesCloneTest-170818781 None] Lock "cinder-e1752a18-2363-42a2-8dc0-1ce3ad096875-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:21 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:04:21 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] Acquiring lock "cinder-ed13fee0-d90e-4109-a512-8d63335eefd8-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] Lock "cinder-ed13fee0-d90e-4109-a512-8d63335eefd8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] Acquiring lock "cinder-quobyte-ed13fee0-d90e-4109-a512-8d63335eefd8" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:21 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] Lock "cinder-quobyte-ed13fee0-d90e-4109-a512-8d63335eefd8" acquired by "delete_volume" :: waited 0.053s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.404s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:21 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Deleted volume successfully. Sep 28 16:04:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0408b454-a2cf-4452-a176-43ab9a0c4770]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9391259d-2ae6-42d6-98d9-6e77cc74efd1 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Lock "cinder-8ebdf2ff-7e97-48ea-a36f-0b16001951ce-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:21 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8 Sep 28 16:04:21 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:22 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8" returned: 0 in 0.782s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:22 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8 Sep 28 16:04:22 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:23 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ed13fee0-d90e-4109-a512-8d63335eefd8" returned: 0 in 0.682s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] Lock "cinder-quobyte-ed13fee0-d90e-4109-a512-8d63335eefd8" released by "delete_volume" :: held 1.596s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] Created reservations ['3d2fdcd6-bbc2-4d44-8243-31da06e7b635', '7cfdd1a2-92bc-4d39-b43c-7036fd6aa70d', 'b9a9a0ba-9fbd-4553-a689-de9bb196bc25', 'e5bab570-4427-4d93-bfa6-6da15f4ab716'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Flow 'volume_create_manager' (6b480d63-3c90-4fa9-9069-a07d6558f179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76319877-4243-49a7-bd31-219b6c2b0648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76319877-4243-49a7-bd31-219b6c2b0648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1095159938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f80c12b-849b-4868-8059-4f6e5816f124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5410455e6b474ab21dfc9bc4b26fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:23Z,use_quota=True,user_id='963d8515f3ce46649930eccd9a8a8389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55bd0e95-e77c-4e97-ae7b-c068a4516a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55bd0e95-e77c-4e97-ae7b-c068a4516a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8bddaaf-fe7d-40c2-a5fc-4d03c1957fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8bddaaf-fe7d-40c2-a5fc-4d03c1957fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f80c12b-849b-4868-8059-4f6e5816f124', 'volume_name': 'volume-7f80c12b-849b-4868-8059-4f6e5816f124', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24eae9a7-4c7f-40ef-95a5-8c3d83afc843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24eae9a7-4c7f-40ef-95a5-8c3d83afc843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (011a1860-a490-498b-9047-7b75f9d9127e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:23 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Volume 7f80c12b-849b-4868-8059-4f6e5816f124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f80c12b-849b-4868-8059-4f6e5816f124', 'volume_size': 1} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1095159938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f80c12b-849b-4868-8059-4f6e5816f124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5410455e6b474ab21dfc9bc4b26fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:23Z,use_quota=True,user_id='963d8515f3ce46649930eccd9a8a8389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Creating volume 7f80c12b-849b-4868-8059-4f6e5816f124 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:04:23 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f80c12b-849b-4868-8059-4f6e5816f124 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:23 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f80c12b-849b-4868-8059-4f6e5816f124 1073741824 Sep 28 16:04:23 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:23 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:04:23 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:24 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.936s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:24 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] Deleted volume successfully. Sep 28 16:04:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2270a9fb-440b-40f9-aea1-80753631ced7 tempest-VolumesCloneTest-170818781 None] Lock "cinder-ed13fee0-d90e-4109-a512-8d63335eefd8-delete_volume" released by "delete_volume" :: held 3.308s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:25 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f80c12b-849b-4868-8059-4f6e5816f124 1073741824" returned: 0 in 1.446s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f80c12b-849b-4868-8059-4f6e5816f124 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:25 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f80c12b-849b-4868-8059-4f6e5816f124 Sep 28 16:04:25 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:25 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f80c12b-849b-4868-8059-4f6e5816f124" returned: 0 in 0.706s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] <== create_volume: return (2238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:04:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.245s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (011a1860-a490-498b-9047-7b75f9d9127e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f80c12b-849b-4868-8059-4f6e5816f124', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c5f829-e6e1-4a56-96c1-43ccf23a7dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:25 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Volume volume-7f80c12b-849b-4868-8059-4f6e5816f124 (7f80c12b-849b-4868-8059-4f6e5816f124): created successfully Sep 28 16:04:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c5f829-e6e1-4a56-96c1-43ccf23a7dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Flow 'volume_create_manager' (6b480d63-3c90-4fa9-9069-a07d6558f179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:25 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9cd98524-49cf-44c4-b5f0-a48872e69d67 tempest-VolumeQuotasAdminTestJSON-1555210397 None] Created volume successfully. Sep 28 16:04:28 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4004e7ac-9565-4826-846c-a87a50cde324 tempest-VolumeQuotasAdminTestJSON-507613616 None] Transfer volume completed successfully. Sep 28 16:04:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] Acquiring lock "cinder-7f80c12b-849b-4868-8059-4f6e5816f124-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] Lock "cinder-7f80c12b-849b-4868-8059-4f6e5816f124-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] Acquiring lock "cinder-quobyte-7f80c12b-849b-4868-8059-4f6e5816f124" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] Lock "cinder-quobyte-7f80c12b-849b-4868-8059-4f6e5816f124" acquired by "delete_volume" :: waited 0.046s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:29 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[922fa155-ef72-4ba4-836b-62d9f12026a2]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f80c12b-849b-4868-8059-4f6e5816f124 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:30 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f80c12b-849b-4868-8059-4f6e5816f124 Sep 28 16:04:30 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:30 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f80c12b-849b-4868-8059-4f6e5816f124" returned: 0 in 0.691s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f80c12b-849b-4868-8059-4f6e5816f124 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:30 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f80c12b-849b-4868-8059-4f6e5816f124 Sep 28 16:04:30 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:30 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f80c12b-849b-4868-8059-4f6e5816f124" returned: 0 in 0.357s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] Lock "cinder-quobyte-7f80c12b-849b-4868-8059-4f6e5816f124" released by "delete_volume" :: held 1.138s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:31 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] Created reservations ['e3f6d7a8-db8c-4f36-b2df-f13830cd6841', 'b09e122c-ed0d-48f9-8fe5-49a043214281', '375ef610-fb19-404b-80d2-74fcc2b848a4', 'e275a2e3-94ce-4345-a71d-bc00b4b72d5f'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:31 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:04:31 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:31 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.280s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:31 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:31 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] Deleted volume successfully. Sep 28 16:04:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34efade3-1af7-4c1a-a76e-ded7f4d6ebf7 tempest-VolumeQuotasAdminTestJSON-1713955762 None] Lock "cinder-7f80c12b-849b-4868-8059-4f6e5816f124-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:31 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Flow 'volume_create_manager' (d6b8b10f-b80a-40ae-871e-8f99137a824c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51843b2e-2193-41a0-9a2f-02f7c330ac2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51843b2e-2193-41a0-9a2f-02f7c330ac2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1353105762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29eed6e8-f969-4a74-a789-f94f2b8ef8fc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9efe337b46134c1c8b965c62d94ae10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:32Z,use_quota=True,user_id='93083d00c016437ea47d8b8a3e19ceaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a52e16-b365-435f-b593-c8b88e02ac10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a52e16-b365-435f-b593-c8b88e02ac10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6648fe91-7e03-444a-a264-55a210cb6475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6648fe91-7e03-444a-a264-55a210cb6475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29eed6e8-f969-4a74-a789-f94f2b8ef8fc', 'volume_name': 'volume-29eed6e8-f969-4a74-a789-f94f2b8ef8fc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6a2526-239c-482e-84f5-327c7e1910d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6a2526-239c-482e-84f5-327c7e1910d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06bc3b4a-36da-47c1-8657-5f236d6276e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:32 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Volume 29eed6e8-f969-4a74-a789-f94f2b8ef8fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29eed6e8-f969-4a74-a789-f94f2b8ef8fc', 'volume_size': 1} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1353105762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29eed6e8-f969-4a74-a789-f94f2b8ef8fc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9efe337b46134c1c8b965c62d94ae10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:32Z,use_quota=True,user_id='93083d00c016437ea47d8b8a3e19ceaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Creating volume 29eed6e8-f969-4a74-a789-f94f2b8ef8fc {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:04:32 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-29eed6e8-f969-4a74-a789-f94f2b8ef8fc 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:32 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-29eed6e8-f969-4a74-a789-f94f2b8ef8fc 1073741824 Sep 28 16:04:32 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:32 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-29eed6e8-f969-4a74-a789-f94f2b8ef8fc 1073741824" returned: 0 in 0.565s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-29eed6e8-f969-4a74-a789-f94f2b8ef8fc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:32 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-29eed6e8-f969-4a74-a789-f94f2b8ef8fc Sep 28 16:04:32 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:33 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-29eed6e8-f969-4a74-a789-f94f2b8ef8fc" returned: 0 in 0.300s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:04:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06bc3b4a-36da-47c1-8657-5f236d6276e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29eed6e8-f969-4a74-a789-f94f2b8ef8fc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6acd7a-5c52-4ebe-95f3-eff2ef8b6696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:33 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Volume volume-29eed6e8-f969-4a74-a789-f94f2b8ef8fc (29eed6e8-f969-4a74-a789-f94f2b8ef8fc): created successfully Sep 28 16:04:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6acd7a-5c52-4ebe-95f3-eff2ef8b6696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Flow 'volume_create_manager' (d6b8b10f-b80a-40ae-871e-8f99137a824c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-220db7b8-c5f5-442b-8516-40ba3a7377da tempest-VolumesGetTest-1549486019 None] Created volume successfully. Sep 28 16:04:34 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:04:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:35 devstack sudo[94028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:04:35 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:35 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.468s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Flow 'volume_create_manager' (021e866a-9c73-44fb-b383-2be4f82bf852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46142b00-496b-46aa-996d-1237c569f7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46142b00-496b-46aa-996d-1237c569f7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-412810823',display_name='tempest-VolumesGetTest-Volume-74409421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e9b04b-857d-4dea-93ff-ab0350848ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efe337b46134c1c8b965c62d94ae10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:36Z,use_quota=True,user_id='93083d00c016437ea47d8b8a3e19ceaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e96d275-0b20-4afb-94e1-e2bc5120e58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e96d275-0b20-4afb-94e1-e2bc5120e58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9595648-c91f-462c-8439-068c5235bf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9595648-c91f-462c-8439-068c5235bf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39e9b04b-857d-4dea-93ff-ab0350848ea2', 'volume_name': 'volume-39e9b04b-857d-4dea-93ff-ab0350848ea2', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf31eb3-1080-41cb-89d7-174f7d66f9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf31eb3-1080-41cb-89d7-174f7d66f9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daeba0cc-a333-4719-b7eb-f51965c5827f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:35 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Volume 39e9b04b-857d-4dea-93ff-ab0350848ea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39e9b04b-857d-4dea-93ff-ab0350848ea2', 'volume_size': 1} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-412810823',display_name='tempest-VolumesGetTest-Volume-74409421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e9b04b-857d-4dea-93ff-ab0350848ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efe337b46134c1c8b965c62d94ae10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:36Z,use_quota=True,user_id='93083d00c016437ea47d8b8a3e19ceaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Creating volume 39e9b04b-857d-4dea-93ff-ab0350848ea2 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:04:35 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:04:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39e9b04b-857d-4dea-93ff-ab0350848ea2 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:35 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39e9b04b-857d-4dea-93ff-ab0350848ea2 1073741824 Sep 28 16:04:35 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:36 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39e9b04b-857d-4dea-93ff-ab0350848ea2 1073741824" returned: 0 in 0.560s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39e9b04b-857d-4dea-93ff-ab0350848ea2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:36 devstack sudo[94038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39e9b04b-857d-4dea-93ff-ab0350848ea2 Sep 28 16:04:36 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:36 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39e9b04b-857d-4dea-93ff-ab0350848ea2" returned: 0 in 0.356s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:04:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daeba0cc-a333-4719-b7eb-f51965c5827f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39e9b04b-857d-4dea-93ff-ab0350848ea2', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4af84ac-24af-45c7-b404-706161d56e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:36 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Volume volume-39e9b04b-857d-4dea-93ff-ab0350848ea2 (39e9b04b-857d-4dea-93ff-ab0350848ea2): created successfully Sep 28 16:04:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4af84ac-24af-45c7-b404-706161d56e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Flow 'volume_create_manager' (021e866a-9c73-44fb-b383-2be4f82bf852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1df97f1d-43c8-4570-9116-477f0f6351d5 tempest-VolumesGetTest-1549486019 None] Created volume successfully. Sep 28 16:04:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] Acquiring lock "cinder-39e9b04b-857d-4dea-93ff-ab0350848ea2-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] Lock "cinder-39e9b04b-857d-4dea-93ff-ab0350848ea2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] Acquiring lock "cinder-quobyte-39e9b04b-857d-4dea-93ff-ab0350848ea2" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] Lock "cinder-quobyte-39e9b04b-857d-4dea-93ff-ab0350848ea2" acquired by "delete_volume" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:38 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c7b549-c5af-4e78-8878-24d63963bb64]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39e9b04b-857d-4dea-93ff-ab0350848ea2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:38 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39e9b04b-857d-4dea-93ff-ab0350848ea2 Sep 28 16:04:38 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:38 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39e9b04b-857d-4dea-93ff-ab0350848ea2" returned: 0 in 0.513s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39e9b04b-857d-4dea-93ff-ab0350848ea2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:38 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39e9b04b-857d-4dea-93ff-ab0350848ea2 Sep 28 16:04:38 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:38 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39e9b04b-857d-4dea-93ff-ab0350848ea2" returned: 0 in 0.353s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] Lock "cinder-quobyte-39e9b04b-857d-4dea-93ff-ab0350848ea2" released by "delete_volume" :: held 0.949s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:39 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] Created reservations ['ed58a495-494e-4a57-af51-d92e1ccfab9f', 'f8f1a4ca-419c-486d-a150-44165f1270a5', 'c850a4d3-3781-4e38-ae6c-3b598702dc77', 'bfbb8e84-606a-47bb-ae7e-ad6b63252c81'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:39 devstack sudo[94073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:04:39 devstack sudo[94073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:39 devstack sudo[94073]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.327s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:39 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] Deleted volume successfully. Sep 28 16:04:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f8f0e186-a623-4fd1-b933-b0b85d480a6a tempest-VolumesGetTest-1549486019 None] Lock "cinder-39e9b04b-857d-4dea-93ff-ab0350848ea2-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] Acquiring lock "cinder-29eed6e8-f969-4a74-a789-f94f2b8ef8fc-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] Lock "cinder-29eed6e8-f969-4a74-a789-f94f2b8ef8fc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] Acquiring lock "cinder-quobyte-29eed6e8-f969-4a74-a789-f94f2b8ef8fc" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] Lock "cinder-quobyte-29eed6e8-f969-4a74-a789-f94f2b8ef8fc" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:40 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a62b36a-5f89-468e-9623-ea8edb719d9f]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-29eed6e8-f969-4a74-a789-f94f2b8ef8fc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:40 devstack sudo[94076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-29eed6e8-f969-4a74-a789-f94f2b8ef8fc Sep 28 16:04:40 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:40 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-29eed6e8-f969-4a74-a789-f94f2b8ef8fc" returned: 0 in 0.574s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-29eed6e8-f969-4a74-a789-f94f2b8ef8fc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:41 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-29eed6e8-f969-4a74-a789-f94f2b8ef8fc Sep 28 16:04:41 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:41 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-29eed6e8-f969-4a74-a789-f94f2b8ef8fc" returned: 0 in 0.347s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] Lock "cinder-quobyte-29eed6e8-f969-4a74-a789-f94f2b8ef8fc" released by "delete_volume" :: held 0.977s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:41 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] Created reservations ['435a32d2-b558-45d2-847b-28c3a113ce00', 'e8892626-8e44-401e-a829-b29a4ff71d06', 'cee9363f-7cd1-426f-966b-613bffb47fb4', '0d9dfeda-18b0-44ef-aeb2-70326db7fdaf'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:41 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:04:41 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:41 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.352s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:41 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:41 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] Deleted volume successfully. Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e8929ea7-f731-4f6d-8f98-688461286159 tempest-VolumesGetTest-1549486019 None] Lock "cinder-29eed6e8-f969-4a74-a789-f94f2b8ef8fc-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Flow 'volume_create_manager' (8b3a6d46-d870-44b9-aaab-f238c14e9ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4d82af-4daf-4c3d-965f-55b3927f1323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4d82af-4daf-4c3d-965f-55b3927f1323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1695374288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d67218b2-2e3b-4af3-ad58-c8f480cc08cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2f1826747a4fe4b3ec3d84ca14b1cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:42Z,use_quota=True,user_id='8cb92dfccafc40109c33c47bbc0af5f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cee55b-3fea-4af6-a35c-7adb791f118b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cee55b-3fea-4af6-a35c-7adb791f118b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7cf9fec-a47e-4ad0-8d9c-d81a63743466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7cf9fec-a47e-4ad0-8d9c-d81a63743466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd67218b2-2e3b-4af3-ad58-c8f480cc08cb', 'volume_name': 'volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2ed49b-4ccb-4fa0-bc83-e3c157f94242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2ed49b-4ccb-4fa0-bc83-e3c157f94242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7768e86-23e7-484e-b557-661073a5f965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:42 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Volume d67218b2-2e3b-4af3-ad58-c8f480cc08cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb', 'volume_size': 1} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1695374288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d67218b2-2e3b-4af3-ad58-c8f480cc08cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2f1826747a4fe4b3ec3d84ca14b1cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:42Z,use_quota=True,user_id='8cb92dfccafc40109c33c47bbc0af5f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Creating volume d67218b2-2e3b-4af3-ad58-c8f480cc08cb {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:04:42 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:04:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:42 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb 1073741824 Sep 28 16:04:42 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:43 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb 1073741824" returned: 0 in 0.834s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Flow 'volume_create_manager' (2f81ed3f-c477-4660-9e52-2343d3e289c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6078fe77-8964-4040-b34b-aa3f6fe7d6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6078fe77-8964-4040-b34b-aa3f6fe7d6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-245714500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e38956a-4c56-4d55-8e5b-32501fdcb94a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efe337b46134c1c8b965c62d94ae10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:43Z,use_quota=True,user_id='93083d00c016437ea47d8b8a3e19ceaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6407be63-1628-44f8-b536-b0ffed39b244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6407be63-1628-44f8-b536-b0ffed39b244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81beded-aa06-4d01-8dab-b9bfe29c50d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81beded-aa06-4d01-8dab-b9bfe29c50d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e38956a-4c56-4d55-8e5b-32501fdcb94a', 'volume_name': 'volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455c5cae-7995-4fe4-a38d-19c8a2263f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455c5cae-7995-4fe4-a38d-19c8a2263f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a43645a-57b8-4276-af43-c663c69e1706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:43 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Volume 1e38956a-4c56-4d55-8e5b-32501fdcb94a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a', 'volume_size': 1} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:43 devstack sudo[94110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb Sep 28 16:04:43 devstack sudo[94110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:43 devstack sudo[94110]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb" returned: 0 in 0.278s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.286s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-245714500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e38956a-4c56-4d55-8e5b-32501fdcb94a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efe337b46134c1c8b965c62d94ae10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:43Z,use_quota=True,user_id='93083d00c016437ea47d8b8a3e19ceaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Creating volume 1e38956a-4c56-4d55-8e5b-32501fdcb94a {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:04:43 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:43 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a 1073741824 Sep 28 16:04:43 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7768e86-23e7-484e-b557-661073a5f965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b0f688-2f44-4d8a-98de-4738aab3dd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:43 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Volume volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb (d67218b2-2e3b-4af3-ad58-c8f480cc08cb): created successfully Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b0f688-2f44-4d8a-98de-4738aab3dd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Flow 'volume_create_manager' (8b3a6d46-d870-44b9-aaab-f238c14e9ff3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:43 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e98c8f7a-d847-4794-8cee-d659a9af14c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Created volume successfully. Sep 28 16:04:44 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a 1073741824" returned: 0 in 0.551s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:44 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a Sep 28 16:04:44 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fef667be-2222-4c91-8ad5-c1493b98b436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:44 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a" returned: 0 in 0.325s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:04:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fef667be-2222-4c91-8ad5-c1493b98b436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-fef667be-2222-4c91-8ad5-c1493b98b436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Creating offline snapshot a9bb13d0-2652-4659-84b5-696b2065dc5d of volume d67218b2-2e3b-4af3-ad58-c8f480cc08cb {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:04:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a43645a-57b8-4276-af43-c663c69e1706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa0b496-462d-4453-a57b-f7a438f4cdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:44 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef01f320-c9bf-464a-b50d-bcd08c64d796]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fef667be-2222-4c91-8ad5-c1493b98b436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:44 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Volume volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a (1e38956a-4c56-4d55-8e5b-32501fdcb94a): created successfully Sep 28 16:04:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa0b496-462d-4453-a57b-f7a438f4cdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Flow 'volume_create_manager' (2f81ed3f-c477-4660-9e52-2343d3e289c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:44 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a67a5acc-3092-41e4-aaa1-597a0f47ca95 tempest-VolumesGetTest-1549486019 None] Created volume successfully. Sep 28 16:04:44 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb Sep 28 16:04:44 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:45 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fef667be-2222-4c91-8ad5-c1493b98b436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb" returned: 0 in 0.398s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fef667be-2222-4c91-8ad5-c1493b98b436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:45 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d 1G Sep 28 16:04:45 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:45 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fef667be-2222-4c91-8ad5-c1493b98b436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d 1G" returned: 0 in 0.543s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fef667be-2222-4c91-8ad5-c1493b98b436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:45 devstack sudo[94133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d Sep 28 16:04:45 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:46 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:04:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Flow 'volume_create_manager' (8fb5da2c-8bac-43b5-866d-3979b224257b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2513dff1-a487-4412-a167-c77db1a5a291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:46 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2513dff1-a487-4412-a167-c77db1a5a291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-527042537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7e82c0-1265-4d4b-8852-3576b1f4e7f1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9efe337b46134c1c8b965c62d94ae10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1e38956a-4c56-4d55-8e5b-32501fdcb94a,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:46Z,use_quota=True,user_id='93083d00c016437ea47d8b8a3e19ceaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a859449d-f25a-4383-92d3-91d2d3562049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a859449d-f25a-4383-92d3-91d2d3562049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b5c5b1-ab56-4a1d-8a9e-89ae9d5d10b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fef667be-2222-4c91-8ad5-c1493b98b436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d" returned: 0 in 0.405s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:46 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-fef667be-2222-4c91-8ad5-c1493b98b436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d is being set with open permissions: ugo+rw Sep 28 16:04:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fef667be-2222-4c91-8ad5-c1493b98b436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:46 devstack sudo[94139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d Sep 28 16:04:46 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b5c5b1-ab56-4a1d-8a9e-89ae9d5d10b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'de7e82c0-1265-4d4b-8852-3576b1f4e7f1', 'volume_name': 'volume-de7e82c0-1265-4d4b-8852-3576b1f4e7f1', 'volume_size': 1, 'source_volid': '1e38956a-4c56-4d55-8e5b-32501fdcb94a', 'source_volstatus': 'available'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9276efa1-06ea-437d-bf84-5e11210e6297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9276efa1-06ea-437d-bf84-5e11210e6297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357f7ead-1c81-4a5e-8f5c-e5c0598b04ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:46 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Volume de7e82c0-1265-4d4b-8852-3576b1f4e7f1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-de7e82c0-1265-4d4b-8852-3576b1f4e7f1', 'volume_size': 1, 'source_volid': '1e38956a-4c56-4d55-8e5b-32501fdcb94a', 'source_volstatus': 'available'} Sep 28 16:04:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:46 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fef667be-2222-4c91-8ad5-c1493b98b436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d" returned: 0 in 0.252s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fef667be-2222-4c91-8ad5-c1493b98b436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:46 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.info Sep 28 16:04:46 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:46 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fef667be-2222-4c91-8ad5-c1493b98b436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.info" returned: 0 in 0.286s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:46 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-fef667be-2222-4c91-8ad5-c1493b98b436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.info is being set with open permissions: ugo+rw Sep 28 16:04:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fef667be-2222-4c91-8ad5-c1493b98b436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:46 devstack sudo[94145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.info Sep 28 16:04:46 devstack sudo[94145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:46 devstack sudo[94145]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fef667be-2222-4c91-8ad5-c1493b98b436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.info" returned: 0 in 0.283s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fef667be-2222-4c91-8ad5-c1493b98b436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.281s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.828s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:47 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Cloning volume 1e38956a-4c56-4d55-8e5b-32501fdcb94a to volume de7e82c0-1265-4d4b-8852-3576b1f4e7f1 Sep 28 16:04:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-fef667be-2222-4c91-8ad5-c1493b98b436 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Create snapshot completed successfully Sep 28 16:04:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Creating offline snapshot b840026b-7188-46d2-93e0-279b60b9ee34 of volume 1e38956a-4c56-4d55-8e5b-32501fdcb94a {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:04:47 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76083d2-686e-455c-aabb-a3c379b07e4a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:47 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a Sep 28 16:04:47 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:47 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a" returned: 0 in 0.445s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:47 devstack sudo[94153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34 1G Sep 28 16:04:47 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:48 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34 1G" returned: 0 in 0.551s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:48 devstack sudo[94159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34 Sep 28 16:04:48 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:48 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Acquiring lock "cinder-a9bb13d0-2652-4659-84b5-696b2065dc5d-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34" returned: 0 in 0.360s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:48 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34 is being set with open permissions: ugo+rw Sep 28 16:04:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Lock "cinder-a9bb13d0-2652-4659-84b5-696b2065dc5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Acquiring lock "cinder-quobyte-d67218b2-2e3b-4af3-ad58-c8f480cc08cb" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:48 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34 Sep 28 16:04:48 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Lock "cinder-quobyte-d67218b2-2e3b-4af3-ad58-c8f480cc08cb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Acquiring lock "cinder-quobyte-a9bb13d0-2652-4659-84b5-696b2065dc5d" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Lock "cinder-quobyte-a9bb13d0-2652-4659-84b5-696b2065dc5d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Deleting offline snapshot a9bb13d0-2652-4659-84b5-696b2065dc5d of volume d67218b2-2e3b-4af3-ad58-c8f480cc08cb {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:04:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] snapshot_file for this snap is: volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:04:48 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d5113f-cd15-4986-86b6-13a5f7bc8325]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:48 devstack sudo[94166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d Sep 28 16:04:48 devstack sudo[94166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:48 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34" returned: 0 in 0.305s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:48 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.info Sep 28 16:04:48 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:48 devstack sudo[94166]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d" returned: 0 in 0.415s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc07d7f-1037-4805-a657-f5c1bd648863]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:49 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.info" returned: 0 in 0.275s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:49 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.info is being set with open permissions: ugo+rw Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:49 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.info Sep 28 16:04:49 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:49 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb Sep 28 16:04:49 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:49 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.info" returned: 0 in 0.266s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Acquiring lock "cinder-quobyte-de7e82c0-1265-4d4b-8852-3576b1f4e7f1" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Lock "cinder-quobyte-de7e82c0-1265-4d4b-8852-3576b1f4e7f1" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] snapshot: b840026b-7188-46d2-93e0-279b60b9ee34, volume: de7e82c0-1265-4d4b-8852-3576b1f4e7f1, {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d651f22-8d8a-4f1e-8cf7-df6c97c71183]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:49 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb" returned: 0 in 0.422s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:49 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d Sep 28 16:04:49 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:49 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34 Sep 28 16:04:49 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:49 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34" returned: 0 in 0.412s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:49 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d" returned: 0 in 0.403s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[111b090b-fbaa-49cf-8f7f-b73412bd8485]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:49 devstack sudo[94193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d Sep 28 16:04:49 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:50 devstack sudo[94194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a Sep 28 16:04:50 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:50 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb.a9bb13d0-2652-4659-84b5-696b2065dc5d" returned: 0 in 0.326s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Lock "cinder-quobyte-a9bb13d0-2652-4659-84b5-696b2065dc5d" released by "_delete_snapshot" :: held 1.727s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Lock "cinder-quobyte-d67218b2-2e3b-4af3-ad58-c8f480cc08cb" released by "delete_snapshot" :: held 1.755s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:50 devstack cinder-volume[87087]: WARNING cinder.quota [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:04:50 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Created reservations ['8cf15c1a-2395-44b0-8e3d-25d4d63f675c', '1f83d5ff-ae6b-40e9-8b54-a3ffb2e35946', '8d6f5678-f716-4985-b896-016bdbf0f45c', 'abb835ff-41e5-4747-81a1-ffab9821bb9b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:50 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a" returned: 0 in 0.540s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:04:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:04:50 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Path /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-de7e82c0-1265-4d4b-8852-3576b1f4e7f1 not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:04:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-de7e82c0-1265-4d4b-8852-3576b1f4e7f1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:50 devstack sudo[94204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-de7e82c0-1265-4d4b-8852-3576b1f4e7f1 Sep 28 16:04:50 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:50 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Delete snapshot completed successfully. Sep 28 16:04:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47f9bf05-f96c-4c68-a070-8610628130e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Lock "cinder-a9bb13d0-2652-4659-84b5-696b2065dc5d-delete_snapshot" released by "delete_snapshot" :: held 2.026s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Acquiring lock "cinder-d67218b2-2e3b-4af3-ad58-c8f480cc08cb-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Lock "cinder-d67218b2-2e3b-4af3-ad58-c8f480cc08cb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Acquiring lock "cinder-quobyte-d67218b2-2e3b-4af3-ad58-c8f480cc08cb" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Lock "cinder-quobyte-d67218b2-2e3b-4af3-ad58-c8f480cc08cb" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:50 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[de558299-5c45-43c7-89f2-7c8a0c3dc3c2]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:51 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb Sep 28 16:04:51 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:51 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb" returned: 0 in 0.783s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:51 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb Sep 28 16:04:51 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:52 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d67218b2-2e3b-4af3-ad58-c8f480cc08cb" returned: 0 in 0.518s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Lock "cinder-quobyte-d67218b2-2e3b-4af3-ad58-c8f480cc08cb" released by "delete_volume" :: held 1.392s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:52 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=72,cinder:UPDATE=90,cinder:INSERT=23,cinder:DELETE=9 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:04:52 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=75,cinder:UPDATE=78,cinder:INSERT=18,cinder:DELETE=6 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:04:52 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Created reservations ['c257576d-cb9a-44da-bc1d-521de7c86799', 'c7acdf45-4729-4b77-865e-516d32550030', '87018884-9aee-45e2-b8ec-33cad12f98fd', 'e2667762-ad51-43af-9b2e-9b5960721070'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:52 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:04:52 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:53 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.679s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:53 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Deleted volume successfully. Sep 28 16:04:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1871ec5-36b7-4058-9d5d-6336315ae365 tempest-VolumeSnapshotQuotasNegativeTestJSON-1464787833 None] Lock "cinder-d67218b2-2e3b-4af3-ad58-c8f480cc08cb-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:00 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-de7e82c0-1265-4d4b-8852-3576b1f4e7f1" returned: 0 in 9.906s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:00 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a, size 1024.00 MB, duration 9.91 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-de7e82c0-1265-4d4b-8852-3576b1f4e7f1 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:05:00 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Converted 1024.00 MB image at 103.36 MB/s Sep 28 16:05:00 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-de7e82c0-1265-4d4b-8852-3576b1f4e7f1 is being set with open permissions: ugo+rw Sep 28 16:05:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-de7e82c0-1265-4d4b-8852-3576b1f4e7f1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:00 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-de7e82c0-1265-4d4b-8852-3576b1f4e7f1 Sep 28 16:05:00 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:00 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-de7e82c0-1265-4d4b-8852-3576b1f4e7f1" returned: 0 in 0.310s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Lock "cinder-quobyte-de7e82c0-1265-4d4b-8852-3576b1f4e7f1" released by "_copy_volume_from_snapshot" :: held 11.269s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Acquiring lock "cinder-quobyte-b840026b-7188-46d2-93e0-279b60b9ee34" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Lock "cinder-quobyte-b840026b-7188-46d2-93e0-279b60b9ee34" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Deleting offline snapshot b840026b-7188-46d2-93e0-279b60b9ee34 of volume 1e38956a-4c56-4d55-8e5b-32501fdcb94a {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:05:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] snapshot_file for this snap is: volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:05:00 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbc0ddf-27b8-4782-b393-83b1f738d4db]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:00 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34 Sep 28 16:05:00 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:01 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34" returned: 0 in 0.492s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:05:01 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5a423e-097f-417d-adc5-a6199e4c259a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:01 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a Sep 28 16:05:01 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] Acquiring lock "cinder-e8628170-2ce0-4586-a0ab-54e35c660b50-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] Lock "cinder-e8628170-2ce0-4586-a0ab-54e35c660b50-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] Acquiring lock "cinder-quobyte-e8628170-2ce0-4586-a0ab-54e35c660b50" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] Lock "cinder-quobyte-e8628170-2ce0-4586-a0ab-54e35c660b50" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:01 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f44127-5d73-4a82-8287-da5860175852]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e8628170-2ce0-4586-a0ab-54e35c660b50 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:01 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e8628170-2ce0-4586-a0ab-54e35c660b50 Sep 28 16:05:01 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:01 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a" returned: 0 in 0.687s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:01 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34 Sep 28 16:05:01 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:02 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e8628170-2ce0-4586-a0ab-54e35c660b50" returned: 0 in 0.408s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e8628170-2ce0-4586-a0ab-54e35c660b50 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:02 devstack sudo[94288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e8628170-2ce0-4586-a0ab-54e35c660b50 Sep 28 16:05:02 devstack sudo[94288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:02 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34" returned: 0 in 0.421s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:02 devstack sudo[94288]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e8628170-2ce0-4586-a0ab-54e35c660b50" returned: 0 in 0.306s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:02 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34 Sep 28 16:05:02 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] Lock "cinder-quobyte-e8628170-2ce0-4586-a0ab-54e35c660b50" released by "delete_volume" :: held 0.770s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] Created reservations ['56a1b04d-0a79-44ef-8afa-9cd791b5ca81', 'a9fe3fa3-4051-43f0-991a-4be862e65b2a', '9eb02d06-d586-43c5-a465-f42293f5e266', 'eef105e9-14dc-4f93-ad1e-725505f4f3da'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:02 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:05:02 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:02 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a.b840026b-7188-46d2-93e0-279b60b9ee34" returned: 0 in 0.327s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Lock "cinder-quobyte-b840026b-7188-46d2-93e0-279b60b9ee34" released by "_delete_snapshot" :: held 2.071s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.814s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357f7ead-1c81-4a5e-8f5c-e5c0598b04ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de7e82c0-1265-4d4b-8852-3576b1f4e7f1', 'volume_size': 1, 'source_volid': '1e38956a-4c56-4d55-8e5b-32501fdcb94a', 'source_volstatus': 'available'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b1851f-b99d-4666-8d6c-86600427488d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:02 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Volume volume-de7e82c0-1265-4d4b-8852-3576b1f4e7f1 (de7e82c0-1265-4d4b-8852-3576b1f4e7f1): created successfully Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b1851f-b99d-4666-8d6c-86600427488d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:02 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Flow 'volume_create_manager' (8fb5da2c-8bac-43b5-866d-3979b224257b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.328s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:02 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] Deleted volume successfully. Sep 28 16:05:02 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1e4df308-d240-4cde-8f10-f1b64cd853d5 tempest-VolumesGetTest-1549486019 None] Created volume successfully. Sep 28 16:05:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-42baf81d-681e-43c6-bbc1-866bb757c9ee tempest-AttachVolumeShelveTestJSON-1788737434 None] Lock "cinder-e8628170-2ce0-4586-a0ab-54e35c660b50-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Flow 'volume_create_manager' (e3025f6c-ca52-4a56-b3c8-09a135ad5e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e3aaed-c7cb-4dd0-946b-1ab84e30e646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e3aaed-c7cb-4dd0-946b-1ab84e30e646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1123188043',display_name='tempest-VolumesGetTest-Volume-405555940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83042994-8402-4a05-9167-30159747731e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efe337b46134c1c8b965c62d94ae10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:05Z,use_quota=True,user_id='93083d00c016437ea47d8b8a3e19ceaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32fa67c0-8d87-484f-b985-1390b233f7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32fa67c0-8d87-484f-b985-1390b233f7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e6e8cdf-e906-4c11-b68d-3987288cf25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e6e8cdf-e906-4c11-b68d-3987288cf25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83042994-8402-4a05-9167-30159747731e', 'volume_name': 'volume-83042994-8402-4a05-9167-30159747731e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e13adc-3859-4218-bbee-507b3a81eda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e13adc-3859-4218-bbee-507b3a81eda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a394d580-bc81-4de5-898b-1488ba370b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:04 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Volume 83042994-8402-4a05-9167-30159747731e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83042994-8402-4a05-9167-30159747731e', 'volume_size': 1} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1123188043',display_name='tempest-VolumesGetTest-Volume-405555940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83042994-8402-4a05-9167-30159747731e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efe337b46134c1c8b965c62d94ae10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:05Z,use_quota=True,user_id='93083d00c016437ea47d8b8a3e19ceaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Creating volume 83042994-8402-4a05-9167-30159747731e {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:05:04 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:05:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83042994-8402-4a05-9167-30159747731e 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:04 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83042994-8402-4a05-9167-30159747731e 1073741824 Sep 28 16:05:04 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:05 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83042994-8402-4a05-9167-30159747731e 1073741824" returned: 0 in 0.548s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83042994-8402-4a05-9167-30159747731e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:05 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83042994-8402-4a05-9167-30159747731e Sep 28 16:05:05 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:05 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83042994-8402-4a05-9167-30159747731e" returned: 0 in 0.327s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:05:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a394d580-bc81-4de5-898b-1488ba370b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83042994-8402-4a05-9167-30159747731e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3938a5f0-feb1-41b1-b252-afd67d1f4aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:05 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Volume volume-83042994-8402-4a05-9167-30159747731e (83042994-8402-4a05-9167-30159747731e): created successfully Sep 28 16:05:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3938a5f0-feb1-41b1-b252-afd67d1f4aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Flow 'volume_create_manager' (e3025f6c-ca52-4a56-b3c8-09a135ad5e18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:05 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2f555a7d-98d4-4ba2-9a76-ae2ecbcd83c3 tempest-VolumesGetTest-1549486019 None] Created volume successfully. Sep 28 16:05:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] Acquiring lock "cinder-83042994-8402-4a05-9167-30159747731e-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] Lock "cinder-83042994-8402-4a05-9167-30159747731e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] Acquiring lock "cinder-quobyte-83042994-8402-4a05-9167-30159747731e" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] Lock "cinder-quobyte-83042994-8402-4a05-9167-30159747731e" acquired by "delete_volume" :: waited 0.035s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:07 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efb46cf-c1bf-45c8-9a28-2755abc1aed7]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83042994-8402-4a05-9167-30159747731e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:07 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83042994-8402-4a05-9167-30159747731e Sep 28 16:05:07 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:08 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83042994-8402-4a05-9167-30159747731e" returned: 0 in 0.716s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83042994-8402-4a05-9167-30159747731e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:08 devstack sudo[94348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83042994-8402-4a05-9167-30159747731e Sep 28 16:05:08 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:08 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83042994-8402-4a05-9167-30159747731e" returned: 0 in 0.475s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] Lock "cinder-quobyte-83042994-8402-4a05-9167-30159747731e" released by "delete_volume" :: held 1.293s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:08 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] Created reservations ['488a4102-39cd-482c-b16d-339b2c27aba3', '8e93e6c7-e5a3-48b0-9a68-eb9aefcdeb18', 'c1321cfa-f8f8-4b13-a6fb-1531329f7aba', '191d67d6-6caf-4ead-92df-34e4f3921464'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:05:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:08 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:05:08 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:09 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.328s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:09 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:09 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] Deleted volume successfully. Sep 28 16:05:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cb56001b-35c0-431c-85a1-18f51c4cde91 tempest-VolumesGetTest-1549486019 None] Lock "cinder-83042994-8402-4a05-9167-30159747731e-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] Acquiring lock "cinder-de7e82c0-1265-4d4b-8852-3576b1f4e7f1-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] Lock "cinder-de7e82c0-1265-4d4b-8852-3576b1f4e7f1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] Acquiring lock "cinder-quobyte-de7e82c0-1265-4d4b-8852-3576b1f4e7f1" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] Lock "cinder-quobyte-de7e82c0-1265-4d4b-8852-3576b1f4e7f1" acquired by "delete_volume" :: waited 0.045s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:10 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fba41a-703d-4885-b237-ab9433b95da9]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-de7e82c0-1265-4d4b-8852-3576b1f4e7f1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-a48c5e92-733b-4ab7-9042-92ad2bc8ad4c tempest-ServerActionsTestOtherA-1617816428 None] Terminate volume connection completed successfully. Sep 28 16:05:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-a48c5e92-733b-4ab7-9042-92ad2bc8ad4c tempest-ServerActionsTestOtherA-1617816428 None] Deleting attachment 499adaf5-787b-44f8-a726-7447c5ea3f73. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:05:10 devstack sudo[94358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-de7e82c0-1265-4d4b-8852-3576b1f4e7f1 Sep 28 16:05:10 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] Acquiring lock "cinder-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] Lock "cinder-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] Acquiring lock "cinder-quobyte-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] Lock "cinder-quobyte-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d" acquired by "delete_volume" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:10 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2f80d1-3e1b-44b8-ac29-a3bb81cd1a71]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:10 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-de7e82c0-1265-4d4b-8852-3576b1f4e7f1" returned: 0 in 0.626s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-de7e82c0-1265-4d4b-8852-3576b1f4e7f1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:10 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-de7e82c0-1265-4d4b-8852-3576b1f4e7f1 Sep 28 16:05:10 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:10 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d Sep 28 16:05:10 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:11 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-de7e82c0-1265-4d4b-8852-3576b1f4e7f1" returned: 0 in 0.528s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] Lock "cinder-quobyte-de7e82c0-1265-4d4b-8852-3576b1f4e7f1" released by "delete_volume" :: held 1.266s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:11 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] Created reservations ['da07b9c1-d5b2-46db-a0ce-1ad5264d05e5', '9aaaa176-4ddb-4443-818b-1091bd380eed', '584ee7c5-3b18-4e47-bfb6-a421870a7081', '649862a2-f89b-4850-b8bd-3fd755c216cd'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:05:11 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d" returned: 0 in 0.834s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:11 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d Sep 28 16:05:11 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] Acquiring lock "cinder-14b03d4c-1cd5-4ca3-8095-8af0934fa311-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] Lock "cinder-14b03d4c-1cd5-4ca3-8095-8af0934fa311-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:11 devstack sudo[94377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:05:11 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] Acquiring lock "cinder-quobyte-14b03d4c-1cd5-4ca3-8095-8af0934fa311" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] Lock "cinder-quobyte-14b03d4c-1cd5-4ca3-8095-8af0934fa311" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:11 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da499e0-3f56-4ff0-bb1d-ba937baa3094]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-14b03d4c-1cd5-4ca3-8095-8af0934fa311 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:12 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-14b03d4c-1cd5-4ca3-8095-8af0934fa311 Sep 28 16:05:12 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:12 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.413s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] Deleted volume successfully. Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a642f7d9-d48a-41c7-a474-22c60f0d1fcc tempest-VolumesGetTest-1549486019 None] Lock "cinder-de7e82c0-1265-4d4b-8852-3576b1f4e7f1-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:12 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d" returned: 0 in 0.690s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] Lock "cinder-quobyte-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d" released by "delete_volume" :: held 1.618s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG cinder.quota [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] Created reservations ['eb2ab366-4813-4fbf-8093-384d443e810e', 'ffab4db9-55a0-4baa-8ea8-aba8ff4e6e49', '6318d7c8-b2ef-4540-bfa0-10b1af4281d5', '551ea22f-d186-4ad1-a703-9046a4ddecdf'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] Acquiring lock "cinder-1e38956a-4c56-4d55-8e5b-32501fdcb94a-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] Lock "cinder-1e38956a-4c56-4d55-8e5b-32501fdcb94a-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:12 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-14b03d4c-1cd5-4ca3-8095-8af0934fa311" returned: 0 in 0.666s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-14b03d4c-1cd5-4ca3-8095-8af0934fa311 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:12 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-14b03d4c-1cd5-4ca3-8095-8af0934fa311 Sep 28 16:05:12 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] Acquiring lock "cinder-quobyte-1e38956a-4c56-4d55-8e5b-32501fdcb94a" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:12 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:05:12 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] Lock "cinder-quobyte-1e38956a-4c56-4d55-8e5b-32501fdcb94a" acquired by "delete_volume" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcb67eb-6e61-4143-a3ee-efb7ff59cdff]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:13 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a Sep 28 16:05:13 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:13 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-14b03d4c-1cd5-4ca3-8095-8af0934fa311" returned: 0 in 0.477s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] Lock "cinder-quobyte-14b03d4c-1cd5-4ca3-8095-8af0934fa311" released by "delete_volume" :: held 1.240s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:13 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.479s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:13 devstack cinder-volume[87087]: DEBUG cinder.manager [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:13 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] Deleted volume successfully. Sep 28 16:05:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-b22ed340-98cd-4384-8f81-b62be6483af2 req-cd72168e-6af4-4e92-88b0-141da55594f9 tempest-ServerActionsTestOtherA-1617816428 None] Lock "cinder-be9ef84a-41b3-457c-a4cb-2ad8158c8e0d-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:13 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] Created reservations ['0235983c-5880-4720-aa00-46ea8f00e8ec', '57e0a732-dd64-4041-8ddb-199dddfcdb3b', '196cd9b6-dc6c-4a3a-b6e3-deb632caa90e', '23628ebd-1f81-4ec3-9e2f-c94ab8ae0e12'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:05:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:13 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:05:13 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:13 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a" returned: 0 in 0.718s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:13 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a Sep 28 16:05:13 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:13 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.448s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:13 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:13 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] Deleted volume successfully. Sep 28 16:05:13 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1e38956a-4c56-4d55-8e5b-32501fdcb94a" returned: 0 in 0.409s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] Lock "cinder-quobyte-1e38956a-4c56-4d55-8e5b-32501fdcb94a" released by "delete_volume" :: held 1.239s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a89201dc-a26b-45d0-9e8d-29c75717e67b tempest-ServerActionsTestOtherA-1617816428 None] Lock "cinder-14b03d4c-1cd5-4ca3-8095-8af0934fa311-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:14 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] Created reservations ['ffd839d0-20e7-43ef-809e-764792eefa1f', 'be0431eb-5edb-4025-a7e1-55798a68cd33', '10624225-fa5c-4abb-b869-65a2886fbfff', '92d6ff37-7a40-4034-a117-924bc4242297'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:05:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:14 devstack sudo[94444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:05:14 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:14 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.394s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:14 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:14 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] Deleted volume successfully. Sep 28 16:05:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e6972d42-fbc8-42c2-b9ab-cfc8cc8d443c tempest-VolumesGetTest-1549486019 None] Lock "cinder-1e38956a-4c56-4d55-8e5b-32501fdcb94a-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:16 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:05:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Flow 'volume_create_manager' (d819a1ce-112a-44fc-8f2b-398b52c61b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4952ffb-3920-4d30-a13a-d6bedc808f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4952ffb-3920-4d30-a13a-d6bedc808f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1274417497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9acc8e8c-3b02-40e5-a4f4-0a63adb70da8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9efe337b46134c1c8b965c62d94ae10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:16Z,use_quota=True,user_id='93083d00c016437ea47d8b8a3e19ceaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496b741a-47de-4bca-ae66-df4b42974f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496b741a-47de-4bca-ae66-df4b42974f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd9d125-ff5c-40bc-9901-226ed2b9e1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:16 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:05:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd9d125-ff5c-40bc-9901-226ed2b9e1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9acc8e8c-3b02-40e5-a4f4-0a63adb70da8', 'volume_name': 'volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8', 'volume_size': 1, 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3682e9714c0d4e0582fb2ca18f45f417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'created_at': datetime.datetime(2026, 9, 28, 13, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7abc4afd-c71a-462f-b806-ba7da0f478cc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26fb94ab-09e8-4f13-8b90-62f4e899c400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26fb94ab-09e8-4f13-8b90-62f4e899c400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d20e51-ce85-4489-ad3f-deb92f80e0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:16 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Volume 9acc8e8c-3b02-40e5-a4f4-0a63adb70da8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8', 'volume_size': 1, 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3682e9714c0d4e0582fb2ca18f45f417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'created_at': datetime.datetime(2026, 9, 28, 13, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7abc4afd-c71a-462f-b806-ba7da0f478cc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 16:05:16 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Trying to clone 9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 from image 7abc4afd-c71a-462f-b806-ba7da0f478cc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:05:17 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_ruyg9extdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:05:17 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Image download 20.69 MB at 20.69 MB/s Sep 28 16:05:17 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cae7a9b-49d4-4c3b-be3d-efaa1a99d42d]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_ruyg9extdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:17 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_ruyg9extdevstack@QuobyteHD Sep 28 16:05:17 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:17 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_ruyg9extdevstack@QuobyteHD" returned: 0 in 0.531s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:18 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Temporary image 7abc4afd-c71a-462f-b806-ba7da0f478cc is fetched for user 93083d00c016437ea47d8b8a3e19ceaf. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:05:18 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad1cc51-9fd9-423b-8541-64cc9b18fe57]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_ruyg9extdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:18 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_ruyg9extdevstack@QuobyteHD Sep 28 16:05:18 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:18 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_ruyg9extdevstack@QuobyteHD" returned: 0 in 0.500s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1274417497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9acc8e8c-3b02-40e5-a4f4-0a63adb70da8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9efe337b46134c1c8b965c62d94ae10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:16Z,use_quota=True,user_id='93083d00c016437ea47d8b8a3e19ceaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:05:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Creating volume 9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:05:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:05:18 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:05:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:18 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 1073741824 Sep 28 16:05:18 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:19 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 1073741824" returned: 0 in 0.617s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:19 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 Sep 28 16:05:19 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:19 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8" returned: 0 in 0.378s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:05:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:19 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Attempting download of 7abc4afd-c71a-462f-b806-ba7da0f478cc ((None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}])) to volume 9acc8e8c-3b02-40e5-a4f4-0a63adb70da8. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:05:19 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2daf197-f3b0-45e6-a8d7-e8b2d63d51a4]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_9hd0pg7k {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:19 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_9hd0pg7k Sep 28 16:05:19 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:20 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_9hd0pg7k" returned: 0 in 0.416s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_9hd0pg7k {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:20 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_9hd0pg7k Sep 28 16:05:20 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:20 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_9hd0pg7k" returned: 1 in 0.463s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_9hd0pg7k' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:05:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4677bfd3-fc97-4c37-8708-f7b2440e87d4]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_ruyg9extdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:20 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_ruyg9extdevstack@QuobyteHD Sep 28 16:05:20 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:21 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_ruyg9extdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:21 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] 7abc4afd-c71a-462f-b806-ba7da0f478cc was qcow2, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:05:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_ruyg9extdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:21 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_ruyg9extdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 Sep 28 16:05:21 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:23 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_ruyg9extdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8" returned: 0 in 2.807s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:23 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_ruyg9extdevstack@QuobyteHD, size 112.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:05:23 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Converted 112.00 MB image at 39.87 MB/s Sep 28 16:05:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:23 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 1G Sep 28 16:05:23 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:24 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 1G" returned: 0 in 0.431s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:24 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Downloaded image 7abc4afd-c71a-462f-b806-ba7da0f478cc ((None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}])) to volume 9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:05:24 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Temporary image 7abc4afd-c71a-462f-b806-ba7da0f478cc for user 93083d00c016437ea47d8b8a3e19ceaf is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:05:24 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Marking volume 9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:05:24 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Copying metadata from image 7abc4afd-c71a-462f-b806-ba7da0f478cc to 9acc8e8c-3b02-40e5-a4f4-0a63adb70da8. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:05:24 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Creating volume glance metadata for volume 9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 backed by image 7abc4afd-c71a-462f-b806-ba7da0f478cc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:05:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d20e51-ce85-4489-ad3f-deb92f80e0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8', 'volume_size': 1, 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3682e9714c0d4e0582fb2ca18f45f417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'created_at': datetime.datetime(2026, 9, 28, 13, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7abc4afd-c71a-462f-b806-ba7da0f478cc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118facdf-e584-4277-b85c-612bb22c888f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:24 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Volume volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 (9acc8e8c-3b02-40e5-a4f4-0a63adb70da8): created successfully Sep 28 16:05:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118facdf-e584-4277-b85c-612bb22c888f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Flow 'volume_create_manager' (d819a1ce-112a-44fc-8f2b-398b52c61b64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ad0ef879-6d8a-4fd5-8051-56310e66b44e tempest-VolumesGetTest-1549486019 None] Created volume successfully. Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Flow 'volume_create_manager' (3d011716-c4e4-426c-b935-88f0925f0134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e865ab9a-ecd4-4e04-8894-d7bfe8322cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e865ab9a-ecd4-4e04-8894-d7bfe8322cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1336077566',display_name='tempest-VolumesGetTest-Volume-1061626032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e50dbb2-35d4-4100-ac6a-0c39ee73e139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efe337b46134c1c8b965c62d94ae10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:26Z,use_quota=True,user_id='93083d00c016437ea47d8b8a3e19ceaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c517be92-8377-42e9-a387-88b961e96107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c517be92-8377-42e9-a387-88b961e96107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72061809-a25b-47a3-a0e3-c7bf0a1cadfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72061809-a25b-47a3-a0e3-c7bf0a1cadfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e50dbb2-35d4-4100-ac6a-0c39ee73e139', 'volume_name': 'volume-4e50dbb2-35d4-4100-ac6a-0c39ee73e139', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5fc8a26-1820-41db-8383-042fce7ff162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5fc8a26-1820-41db-8383-042fce7ff162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524d2d3b-88fb-4843-8fdd-35b9c01492fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:26 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Volume 4e50dbb2-35d4-4100-ac6a-0c39ee73e139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e50dbb2-35d4-4100-ac6a-0c39ee73e139', 'volume_size': 1} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1336077566',display_name='tempest-VolumesGetTest-Volume-1061626032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e50dbb2-35d4-4100-ac6a-0c39ee73e139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efe337b46134c1c8b965c62d94ae10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:26Z,use_quota=True,user_id='93083d00c016437ea47d8b8a3e19ceaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Creating volume 4e50dbb2-35d4-4100-ac6a-0c39ee73e139 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:05:26 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4e50dbb2-35d4-4100-ac6a-0c39ee73e139 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:26 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4e50dbb2-35d4-4100-ac6a-0c39ee73e139 1073741824 Sep 28 16:05:26 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:26 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4e50dbb2-35d4-4100-ac6a-0c39ee73e139 1073741824" returned: 0 in 0.769s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4e50dbb2-35d4-4100-ac6a-0c39ee73e139 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:27 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4e50dbb2-35d4-4100-ac6a-0c39ee73e139 Sep 28 16:05:27 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:27 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4e50dbb2-35d4-4100-ac6a-0c39ee73e139" returned: 0 in 0.383s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:05:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524d2d3b-88fb-4843-8fdd-35b9c01492fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e50dbb2-35d4-4100-ac6a-0c39ee73e139', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ae8443-853e-45d6-ad03-fc59306b4b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:27 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Volume volume-4e50dbb2-35d4-4100-ac6a-0c39ee73e139 (4e50dbb2-35d4-4100-ac6a-0c39ee73e139): created successfully Sep 28 16:05:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ae8443-853e-45d6-ad03-fc59306b4b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Flow 'volume_create_manager' (3d011716-c4e4-426c-b935-88f0925f0134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-597c082a-3803-4354-8068-29d008db45eb tempest-VolumesGetTest-1549486019 None] Created volume successfully. Sep 28 16:05:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] Acquiring lock "cinder-4e50dbb2-35d4-4100-ac6a-0c39ee73e139-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] Lock "cinder-4e50dbb2-35d4-4100-ac6a-0c39ee73e139-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] Acquiring lock "cinder-quobyte-4e50dbb2-35d4-4100-ac6a-0c39ee73e139" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] Lock "cinder-quobyte-4e50dbb2-35d4-4100-ac6a-0c39ee73e139" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:28 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee86e29f-bf51-4e9f-871e-31a15bc9a736]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4e50dbb2-35d4-4100-ac6a-0c39ee73e139 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:28 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4e50dbb2-35d4-4100-ac6a-0c39ee73e139 Sep 28 16:05:28 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:29 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4e50dbb2-35d4-4100-ac6a-0c39ee73e139" returned: 0 in 0.608s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4e50dbb2-35d4-4100-ac6a-0c39ee73e139 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:29 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4e50dbb2-35d4-4100-ac6a-0c39ee73e139 Sep 28 16:05:29 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:29 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4e50dbb2-35d4-4100-ac6a-0c39ee73e139" returned: 0 in 0.301s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] Lock "cinder-quobyte-4e50dbb2-35d4-4100-ac6a-0c39ee73e139" released by "delete_volume" :: held 0.992s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:29 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] Created reservations ['439933ea-1a88-4059-b09e-cdd31f198262', '59a905ab-fac4-4ece-86bc-801a3bbcb838', '28b064ad-4b89-4485-82bb-a13eb2a55114', '3b3ca23a-7640-482d-8317-ee960545bd3b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:05:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:29 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:05:29 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:30 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.392s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:30 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] Deleted volume successfully. Sep 28 16:05:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0ae60048-18cd-44c9-b9da-2e19de32d713 tempest-VolumesGetTest-1549486019 None] Lock "cinder-4e50dbb2-35d4-4100-ac6a-0c39ee73e139-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] Acquiring lock "cinder-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] Lock "cinder-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] Acquiring lock "cinder-quobyte-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] Lock "cinder-quobyte-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8" acquired by "delete_volume" :: waited 0.039s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce88e89-8fd1-4946-802d-e141f75daf89]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:31 devstack sudo[94553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 Sep 28 16:05:31 devstack sudo[94553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:31 devstack sudo[94553]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8" returned: 0 in 0.540s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:31 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8 Sep 28 16:05:31 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:31 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8" returned: 0 in 0.331s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] Lock "cinder-quobyte-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8" released by "delete_volume" :: held 0.957s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:32 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] Created reservations ['d014df7e-c991-44fe-84bb-7dc2ac10f9f3', '0e31e078-7958-42dd-b38f-e1443d0357b5', 'c9d532de-9e78-43f5-b96c-37977e597c83', '6dcd2889-6f2a-4686-bfec-b71d8bec134e'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:05:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:32 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:05:32 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:32 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.332s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:32 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:32 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] Deleted volume successfully. Sep 28 16:05:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6e72d089-9a35-4268-a499-903007933090 tempest-VolumesGetTest-1549486019 None] Lock "cinder-9acc8e8c-3b02-40e5-a4f4-0a63adb70da8-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:34 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:05:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:35 devstack sudo[94566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:05:35 devstack sudo[94566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:35 devstack sudo[94566]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.506s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:05:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:05:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Flow 'volume_create_manager' (11aee937-a98b-4fa9-a529-b82a5839c480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24596f4b-4440-4e22-929a-49ba8df2ec69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24596f4b-4440-4e22-929a-49ba8df2ec69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1504511047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b23fdc-68ac-46bf-bca1-4870268242d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc844bc0fdfb4097b38a695fd719bbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:38Z,use_quota=True,user_id='ebf767ce10ec43f4ac72e72c88753957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3b42ee-4e44-4697-9951-97485333c536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3b42ee-4e44-4697-9951-97485333c536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdfd2e5-82a0-47ba-b47b-d20c25d57f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdfd2e5-82a0-47ba-b47b-d20c25d57f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83b23fdc-68ac-46bf-bca1-4870268242d8', 'volume_name': 'volume-83b23fdc-68ac-46bf-bca1-4870268242d8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd64aea-321b-4c51-af5a-6f856bcabfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd64aea-321b-4c51-af5a-6f856bcabfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6898b13-7803-404b-8da9-31f7ec8d6269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:38 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Volume 83b23fdc-68ac-46bf-bca1-4870268242d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83b23fdc-68ac-46bf-bca1-4870268242d8', 'volume_size': 1} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1504511047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b23fdc-68ac-46bf-bca1-4870268242d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc844bc0fdfb4097b38a695fd719bbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:38Z,use_quota=True,user_id='ebf767ce10ec43f4ac72e72c88753957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Creating volume 83b23fdc-68ac-46bf-bca1-4870268242d8 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:05:38 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:05:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83b23fdc-68ac-46bf-bca1-4870268242d8 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:38 devstack sudo[94573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83b23fdc-68ac-46bf-bca1-4870268242d8 1073741824 Sep 28 16:05:38 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:39 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83b23fdc-68ac-46bf-bca1-4870268242d8 1073741824" returned: 0 in 0.928s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83b23fdc-68ac-46bf-bca1-4870268242d8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:39 devstack sudo[94578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83b23fdc-68ac-46bf-bca1-4870268242d8 Sep 28 16:05:39 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:39 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83b23fdc-68ac-46bf-bca1-4870268242d8" returned: 0 in 0.453s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:05:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6898b13-7803-404b-8da9-31f7ec8d6269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83b23fdc-68ac-46bf-bca1-4870268242d8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4795be24-3d5b-4ae4-bdc6-a05e64578620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:39 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Volume volume-83b23fdc-68ac-46bf-bca1-4870268242d8 (83b23fdc-68ac-46bf-bca1-4870268242d8): created successfully Sep 28 16:05:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4795be24-3d5b-4ae4-bdc6-a05e64578620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Flow 'volume_create_manager' (11aee937-a98b-4fa9-a529-b82a5839c480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-09134e65-9127-4e32-8fcf-f789e50d1943 tempest-VolumesTransfersV355Test-939924654 None] Created volume successfully. Sep 28 16:05:41 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4dc5fbf8-3c57-47bb-b368-f3a7c2e1197b tempest-VolumesTransfersV355Test-840484960 None] Transfer volume completed successfully. Sep 28 16:05:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] Acquiring lock "cinder-83b23fdc-68ac-46bf-bca1-4870268242d8-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] Lock "cinder-83b23fdc-68ac-46bf-bca1-4870268242d8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] Acquiring lock "cinder-quobyte-83b23fdc-68ac-46bf-bca1-4870268242d8" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] Lock "cinder-quobyte-83b23fdc-68ac-46bf-bca1-4870268242d8" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:42 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c6623b-bb8d-41df-acdf-fe0ad199d9fb]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83b23fdc-68ac-46bf-bca1-4870268242d8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:42 devstack sudo[94598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83b23fdc-68ac-46bf-bca1-4870268242d8 Sep 28 16:05:42 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:43 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83b23fdc-68ac-46bf-bca1-4870268242d8" returned: 0 in 0.625s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83b23fdc-68ac-46bf-bca1-4870268242d8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:43 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83b23fdc-68ac-46bf-bca1-4870268242d8 Sep 28 16:05:43 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:43 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-83b23fdc-68ac-46bf-bca1-4870268242d8" returned: 0 in 0.501s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] Lock "cinder-quobyte-83b23fdc-68ac-46bf-bca1-4870268242d8" released by "delete_volume" :: held 1.203s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:43 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] Created reservations ['a0afa210-2a5d-4c50-819d-5efcaa18afd7', 'c8ab2a31-0cdb-430c-b707-79bec18a57b7', 'b95391ec-8935-4071-b3f1-0f1591a290b4', '31e4d6c0-7891-46a4-a680-8522d4689a0e'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:05:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:44 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:05:44 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:44 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.378s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:44 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:44 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] Deleted volume successfully. Sep 28 16:05:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8a9a7351-2353-42b7-996a-065b8ada4a54 tempest-VolumesTransfersV355Test-1747535133 None] Lock "cinder-83b23fdc-68ac-46bf-bca1-4870268242d8-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Flow 'volume_create_manager' (fd8da331-c951-452f-9ea9-a67614fffc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ee42c0-6608-4f6f-b52f-64844323fd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ee42c0-6608-4f6f-b52f-64844323fd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1717089410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc844bc0fdfb4097b38a695fd719bbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:46Z,use_quota=True,user_id='ebf767ce10ec43f4ac72e72c88753957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc90a9a1-7c8f-445c-8195-13618fbf02b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc90a9a1-7c8f-445c-8195-13618fbf02b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10115eba-79fd-4335-b0f8-dacbf720be30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10115eba-79fd-4335-b0f8-dacbf720be30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328', 'volume_name': 'volume-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2b3b53-08d6-4a56-8504-078161b3c17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2b3b53-08d6-4a56-8504-078161b3c17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b770e470-6b19-46b2-afbb-f25f08485f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:46 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Volume 46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328', 'volume_size': 1} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1717089410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc844bc0fdfb4097b38a695fd719bbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:46Z,use_quota=True,user_id='ebf767ce10ec43f4ac72e72c88753957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Creating volume 46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:05:46 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:46 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328 1073741824 Sep 28 16:05:46 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Flow 'volume_create_manager' (c8695a59-07b7-4453-80d2-ed99eb78b922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ed3d65-35b4-4a93-9631-bce13ac87343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ed3d65-35b4-4a93-9631-bce13ac87343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2091888950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb64979b-3c83-4ca3-a50e-6dbcf1cac138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587e4d56ddc743c0a1dc19966998370f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:46Z,use_quota=True,user_id='5bc0aed0d9f045d7b9bd64b216f4bf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3664a2-30e3-405a-a7db-9ea6b4674031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3664a2-30e3-405a-a7db-9ea6b4674031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8340df50-fdab-47ab-983b-698b2e78072c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8340df50-fdab-47ab-983b-698b2e78072c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb64979b-3c83-4ca3-a50e-6dbcf1cac138', 'volume_name': 'volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d62b0b1-a1e3-4331-930f-146bc8a67096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d62b0b1-a1e3-4331-930f-146bc8a67096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f5a1dc-5aa9-49c6-bfeb-ce9c0e66bbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:47 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Volume cb64979b-3c83-4ca3-a50e-6dbcf1cac138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138', 'volume_size': 1} Sep 28 16:05:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:47 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328 1073741824" returned: 0 in 1.317s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:47 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328 Sep 28 16:05:47 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:48 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328" returned: 0 in 0.557s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:05:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.175s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2091888950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb64979b-3c83-4ca3-a50e-6dbcf1cac138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587e4d56ddc743c0a1dc19966998370f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:46Z,use_quota=True,user_id='5bc0aed0d9f045d7b9bd64b216f4bf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:05:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Creating volume cb64979b-3c83-4ca3-a50e-6dbcf1cac138 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:05:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:05:48 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:05:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b770e470-6b19-46b2-afbb-f25f08485f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7baa1a42-98bb-4b9a-8885-bfa869475064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:48 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138 1073741824 Sep 28 16:05:48 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:48 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Volume volume-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328 (46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328): created successfully Sep 28 16:05:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7baa1a42-98bb-4b9a-8885-bfa869475064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Flow 'volume_create_manager' (fd8da331-c951-452f-9ea9-a67614fffc69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:48 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-20d85fc8-1f64-4796-a171-2cd90d4103e8 tempest-VolumesTransfersV355Test-939924654 None] Created volume successfully. Sep 28 16:05:49 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138 1073741824" returned: 0 in 0.991s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:49 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138 Sep 28 16:05:49 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:49 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138" returned: 0 in 0.636s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:05:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f5a1dc-5aa9-49c6-bfeb-ce9c0e66bbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0d5332-f20e-4f87-b20e-f70c8644de42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:50 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Volume volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138 (cb64979b-3c83-4ca3-a50e-6dbcf1cac138): created successfully Sep 28 16:05:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0d5332-f20e-4f87-b20e-f70c8644de42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Flow 'volume_create_manager' (c8695a59-07b7-4453-80d2-ed99eb78b922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:50 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-06d3810d-00e4-4770-9982-1a79f203b444 tempest-VolumesSnapshotListTestJSON-1682736709 None] Created volume successfully. Sep 28 16:05:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] Acquiring lock "cinder-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] Lock "cinder-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] Acquiring lock "cinder-quobyte-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] Lock "cinder-quobyte-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328" acquired by "delete_volume" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:50 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c430b555-2f15-4087-bd97-ccd29b509732]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-40aeb117-c00a-49ef-b03b-02c5e2308a23 tempest-VolumesSnapshotListTestJSON-1682736709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-40aeb117-c00a-49ef-b03b-02c5e2308a23 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-40aeb117-c00a-49ef-b03b-02c5e2308a23 tempest-VolumesSnapshotListTestJSON-1682736709 None] Creating offline snapshot 117c9770-2247-464a-ba0e-9aeb04dc2622 of volume cb64979b-3c83-4ca3-a50e-6dbcf1cac138 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:05:50 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328 Sep 28 16:05:50 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:50 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f0af29-6cd7-4e76-a6cf-910dd78d9f90]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-40aeb117-c00a-49ef-b03b-02c5e2308a23 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:51 devstack sudo[94719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138 Sep 28 16:05:51 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:51 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328" returned: 0 in 0.948s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:51 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328 Sep 28 16:05:51 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:51 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-40aeb117-c00a-49ef-b03b-02c5e2308a23 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138" returned: 0 in 0.872s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-40aeb117-c00a-49ef-b03b-02c5e2308a23 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:51 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 1G Sep 28 16:05:51 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:51 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328" returned: 0 in 0.438s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] Lock "cinder-quobyte-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328" released by "delete_volume" :: held 1.506s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:52 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] Created reservations ['ab156c74-223e-40fb-ab93-2b52898dc205', '332d82b2-afae-476e-9e18-9c4d5629239c', '7f80f310-0d59-42d9-999a-e2f304d47c8d', '4c6cda2c-d0ba-47bc-8351-22199a2601e6'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:05:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:52 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:05:52 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:52 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:52 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.563s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:52 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-40aeb117-c00a-49ef-b03b-02c5e2308a23 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 1G" returned: 0 in 1.057s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-40aeb117-c00a-49ef-b03b-02c5e2308a23 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:52 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] Deleted volume successfully. Sep 28 16:05:52 devstack sudo[94739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 Sep 28 16:05:52 devstack sudo[94739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:52 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=76,cinder:INSERT=30,cinder:UPDATE=114,cinder:DELETE=6 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:05:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bbc660a0-1600-40fe-8e57-f282e59bb0c1 tempest-VolumesTransfersV355Test-1747535133 None] Lock "cinder-46cd2f4a-7a99-4d4d-8c6d-fa7e1e3a6328-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:53 devstack sudo[94739]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-40aeb117-c00a-49ef-b03b-02c5e2308a23 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622" returned: 0 in 0.874s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:53 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-40aeb117-c00a-49ef-b03b-02c5e2308a23 tempest-VolumesSnapshotListTestJSON-1682736709 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 is being set with open permissions: ugo+rw Sep 28 16:05:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-40aeb117-c00a-49ef-b03b-02c5e2308a23 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:53 devstack sudo[94748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 Sep 28 16:05:53 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:54 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-40aeb117-c00a-49ef-b03b-02c5e2308a23 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622" returned: 0 in 0.545s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:54 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:INSERT=34,cinder:UPDATE=108,cinder:SELECT=77,cinder:DELETE=12 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:05:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-40aeb117-c00a-49ef-b03b-02c5e2308a23 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:54 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.info Sep 28 16:05:54 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:55 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-40aeb117-c00a-49ef-b03b-02c5e2308a23 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.info" returned: 0 in 0.658s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:55 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-40aeb117-c00a-49ef-b03b-02c5e2308a23 tempest-VolumesSnapshotListTestJSON-1682736709 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.info is being set with open permissions: ugo+rw Sep 28 16:05:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-40aeb117-c00a-49ef-b03b-02c5e2308a23 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:55 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.info Sep 28 16:05:55 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:55 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-40aeb117-c00a-49ef-b03b-02c5e2308a23 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.info" returned: 0 in 0.444s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-40aeb117-c00a-49ef-b03b-02c5e2308a23 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.753s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:55 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-40aeb117-c00a-49ef-b03b-02c5e2308a23 tempest-VolumesSnapshotListTestJSON-1682736709 None] Create snapshot completed successfully Sep 28 16:05:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-739479b7-fe9b-4c69-a1e2-c89f4d4e6dc8 tempest-VolumesSnapshotListTestJSON-1682736709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-739479b7-fe9b-4c69-a1e2-c89f4d4e6dc8 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-739479b7-fe9b-4c69-a1e2-c89f4d4e6dc8 tempest-VolumesSnapshotListTestJSON-1682736709 None] Creating offline snapshot 3491f41d-6133-4aeb-a639-5da198796fe0 of volume cb64979b-3c83-4ca3-a50e-6dbcf1cac138 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:05:57 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[baba0f17-1ebf-4b48-a97c-570c87b6019a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-739479b7-fe9b-4c69-a1e2-c89f4d4e6dc8 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:57 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 Sep 28 16:05:57 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:57 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-739479b7-fe9b-4c69-a1e2-c89f4d4e6dc8 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622" returned: 0 in 0.774s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-739479b7-fe9b-4c69-a1e2-c89f4d4e6dc8 tempest-VolumesSnapshotListTestJSON-1682736709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:05:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-739479b7-fe9b-4c69-a1e2-c89f4d4e6dc8 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:57 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 1G Sep 28 16:05:57 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:59 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-739479b7-fe9b-4c69-a1e2-c89f4d4e6dc8 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 1G" returned: 0 in 1.242s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-739479b7-fe9b-4c69-a1e2-c89f4d4e6dc8 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:59 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 Sep 28 16:05:59 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:59 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-739479b7-fe9b-4c69-a1e2-c89f4d4e6dc8 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0" returned: 0 in 0.660s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:59 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-739479b7-fe9b-4c69-a1e2-c89f4d4e6dc8 tempest-VolumesSnapshotListTestJSON-1682736709 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 is being set with open permissions: ugo+rw Sep 28 16:05:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-739479b7-fe9b-4c69-a1e2-c89f4d4e6dc8 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:59 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 Sep 28 16:05:59 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:00 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-739479b7-fe9b-4c69-a1e2-c89f4d4e6dc8 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0" returned: 0 in 0.451s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-739479b7-fe9b-4c69-a1e2-c89f4d4e6dc8 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.455s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-739479b7-fe9b-4c69-a1e2-c89f4d4e6dc8 tempest-VolumesSnapshotListTestJSON-1682736709 None] Create snapshot completed successfully Sep 28 16:06:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8b0089c1-d5a1-4b5d-a17b-5d9c9762471a tempest-VolumesSnapshotListTestJSON-1682736709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8b0089c1-d5a1-4b5d-a17b-5d9c9762471a tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8b0089c1-d5a1-4b5d-a17b-5d9c9762471a tempest-VolumesSnapshotListTestJSON-1682736709 None] Creating offline snapshot 594c67ce-8a2b-41e8-80ed-511d7940105d of volume cb64979b-3c83-4ca3-a50e-6dbcf1cac138 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:06:01 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e93fde-8882-4016-9ab8-a97209fbe5ca]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b0089c1-d5a1-4b5d-a17b-5d9c9762471a tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:01 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 Sep 28 16:06:01 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:02 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b0089c1-d5a1-4b5d-a17b-5d9c9762471a tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0" returned: 0 in 0.622s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8b0089c1-d5a1-4b5d-a17b-5d9c9762471a tempest-VolumesSnapshotListTestJSON-1682736709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:06:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b0089c1-d5a1-4b5d-a17b-5d9c9762471a tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:02 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d 1G Sep 28 16:06:02 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:03 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b0089c1-d5a1-4b5d-a17b-5d9c9762471a tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d 1G" returned: 0 in 0.989s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b0089c1-d5a1-4b5d-a17b-5d9c9762471a tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:03 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d Sep 28 16:06:03 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:04 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b0089c1-d5a1-4b5d-a17b-5d9c9762471a tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d" returned: 0 in 0.981s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:04 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-8b0089c1-d5a1-4b5d-a17b-5d9c9762471a tempest-VolumesSnapshotListTestJSON-1682736709 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d is being set with open permissions: ugo+rw Sep 28 16:06:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b0089c1-d5a1-4b5d-a17b-5d9c9762471a tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:04 devstack sudo[94855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d Sep 28 16:06:04 devstack sudo[94855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:05 devstack sudo[94855]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b0089c1-d5a1-4b5d-a17b-5d9c9762471a tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d" returned: 0 in 0.692s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8b0089c1-d5a1-4b5d-a17b-5d9c9762471a tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.576s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:05 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8b0089c1-d5a1-4b5d-a17b-5d9c9762471a tempest-VolumesSnapshotListTestJSON-1682736709 None] Create snapshot completed successfully Sep 28 16:06:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] Acquiring lock "cinder-594c67ce-8a2b-41e8-80ed-511d7940105d-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-594c67ce-8a2b-41e8-80ed-511d7940105d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] Acquiring lock "cinder-quobyte-cb64979b-3c83-4ca3-a50e-6dbcf1cac138" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-quobyte-cb64979b-3c83-4ca3-a50e-6dbcf1cac138" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] Acquiring lock "cinder-quobyte-594c67ce-8a2b-41e8-80ed-511d7940105d" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-quobyte-594c67ce-8a2b-41e8-80ed-511d7940105d" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] Deleting offline snapshot 594c67ce-8a2b-41e8-80ed-511d7940105d of volume cb64979b-3c83-4ca3-a50e-6dbcf1cac138 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:06:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] snapshot_file for this snap is: volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:06:08 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b88deb-8373-4c30-b01a-e11a5d198a48]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:08 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d Sep 28 16:06:08 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:08 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d" returned: 0 in 0.746s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:06:09 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[de23a7f3-4ce7-4b6d-9d28-10ae34b878a4]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:09 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 Sep 28 16:06:09 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:09 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0" returned: 0 in 0.911s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:06:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:10 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d Sep 28 16:06:10 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:11 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d" returned: 0 in 1.159s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:11 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d Sep 28 16:06:11 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:11 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.594c67ce-8a2b-41e8-80ed-511d7940105d" returned: 0 in 0.653s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-quobyte-594c67ce-8a2b-41e8-80ed-511d7940105d" released by "_delete_snapshot" :: held 3.686s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-quobyte-cb64979b-3c83-4ca3-a50e-6dbcf1cac138" released by "delete_snapshot" :: held 3.744s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:12 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] Created reservations ['c8f40240-f50b-45e3-b4fd-604d7fcfa17a', 'f70b1ce4-0dbd-4632-961c-534608cc557c', 'a7cc99e1-3159-413c-b5f0-7479ee2e156d', '0fe783bb-545b-49e0-af9e-fad7bd03a476'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:06:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] Delete snapshot completed successfully. Sep 28 16:06:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4fa9563-3a2a-4b46-9fdf-cfaea179980e tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-594c67ce-8a2b-41e8-80ed-511d7940105d-delete_snapshot" released by "delete_snapshot" :: held 4.175s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] Acquiring lock "cinder-3491f41d-6133-4aeb-a639-5da198796fe0-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-3491f41d-6133-4aeb-a639-5da198796fe0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] Acquiring lock "cinder-quobyte-cb64979b-3c83-4ca3-a50e-6dbcf1cac138" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-quobyte-cb64979b-3c83-4ca3-a50e-6dbcf1cac138" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] Acquiring lock "cinder-quobyte-3491f41d-6133-4aeb-a639-5da198796fe0" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-quobyte-3491f41d-6133-4aeb-a639-5da198796fe0" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] Deleting offline snapshot 3491f41d-6133-4aeb-a639-5da198796fe0 of volume cb64979b-3c83-4ca3-a50e-6dbcf1cac138 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:06:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] snapshot_file for this snap is: volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:06:13 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db19a46-271b-43c9-b682-bc0c9f70dc42]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:13 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 Sep 28 16:06:13 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:13 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0" returned: 0 in 0.860s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:06:14 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08b7753-8309-4539-aa94-459fe0dc35d5]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:14 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 Sep 28 16:06:14 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:15 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622" returned: 0 in 1.337s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:06:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:15 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 Sep 28 16:06:15 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0" returned: 0 in 1.167s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:16 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:16 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0 Sep 28 16:06:16 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:17 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.3491f41d-6133-4aeb-a639-5da198796fe0" returned: 0 in 0.529s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-quobyte-3491f41d-6133-4aeb-a639-5da198796fe0" released by "_delete_snapshot" :: held 4.290s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-quobyte-cb64979b-3c83-4ca3-a50e-6dbcf1cac138" released by "delete_snapshot" :: held 4.349s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:17 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] Created reservations ['83351a8d-e3ad-459d-9efc-d88c8271751c', '3e389155-bd5b-4190-90d5-73a5065444af', '4c52c398-771f-4792-90e0-614e712d4374', '1f00a004-a564-49d5-9b42-aedacd9c483e'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:06:17 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] Delete snapshot completed successfully. Sep 28 16:06:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2977ff2f-be9b-48d4-b9b4-6292cd3d0df0 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-3491f41d-6133-4aeb-a639-5da198796fe0-delete_snapshot" released by "delete_snapshot" :: held 4.761s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] Acquiring lock "cinder-117c9770-2247-464a-ba0e-9aeb04dc2622-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-117c9770-2247-464a-ba0e-9aeb04dc2622-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] Acquiring lock "cinder-quobyte-cb64979b-3c83-4ca3-a50e-6dbcf1cac138" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-quobyte-cb64979b-3c83-4ca3-a50e-6dbcf1cac138" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] Acquiring lock "cinder-quobyte-117c9770-2247-464a-ba0e-9aeb04dc2622" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-quobyte-117c9770-2247-464a-ba0e-9aeb04dc2622" acquired by "_delete_snapshot" :: waited 0.124s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] Deleting offline snapshot 117c9770-2247-464a-ba0e-9aeb04dc2622 of volume cb64979b-3c83-4ca3-a50e-6dbcf1cac138 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:06:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] snapshot_file for this snap is: volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:06:18 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fc68a3-27f2-4eed-9c88-093f95c09507]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:18 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 Sep 28 16:06:18 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:19 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622" returned: 0 in 0.744s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:06:19 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7aca76-e48d-4303-91e3-88383a7c0e9a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:19 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138 Sep 28 16:06:19 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:20 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138" returned: 0 in 0.653s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:20 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 Sep 28 16:06:20 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:20 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622" returned: 0 in 0.686s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:20 devstack sudo[95191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622 Sep 28 16:06:20 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:21 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138.117c9770-2247-464a-ba0e-9aeb04dc2622" returned: 0 in 0.560s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-quobyte-117c9770-2247-464a-ba0e-9aeb04dc2622" released by "_delete_snapshot" :: held 2.971s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-quobyte-cb64979b-3c83-4ca3-a50e-6dbcf1cac138" released by "delete_snapshot" :: held 3.126s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:21 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] Created reservations ['e27117bf-af64-4537-bc08-fd86a0f91c18', 'f1f1f4e5-52d6-4f2b-b796-312be5811a3a', '43d93cb2-8f03-41da-8dcd-98a1b7a6f78c', 'a7fb615a-770c-4b35-b422-3655bf68b5a8'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:06:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] Delete snapshot completed successfully. Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6c3c31e3-9bd7-488e-b3d4-abda26175af4 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-117c9770-2247-464a-ba0e-9aeb04dc2622-delete_snapshot" released by "delete_snapshot" :: held 3.642s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Flow 'volume_create_manager' (0580d6a5-1c12-40fb-8e4c-8b2de998853c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e692e619-a24f-4804-9100-3266d50b0727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e692e619-a24f-4804-9100-3266d50b0727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-836901215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208d81d7-3518-4d60-97f4-37616edbfc93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c222d31ec51848279de98269d6837905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:22Z,use_quota=True,user_id='08f9986f124e440a84f9020544ba598f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09163bfc-6df4-47b3-9618-9e6ac16a6741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09163bfc-6df4-47b3-9618-9e6ac16a6741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be23258-7833-496f-a0ad-eb64ddc2395f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be23258-7833-496f-a0ad-eb64ddc2395f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '208d81d7-3518-4d60-97f4-37616edbfc93', 'volume_name': 'volume-208d81d7-3518-4d60-97f4-37616edbfc93', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42391268-f808-46fa-aa1b-a3d5b31762d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42391268-f808-46fa-aa1b-a3d5b31762d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f6ec06-cf74-4d31-bcb8-4996515ffe23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:22 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Volume 208d81d7-3518-4d60-97f4-37616edbfc93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-208d81d7-3518-4d60-97f4-37616edbfc93', 'volume_size': 1} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-836901215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208d81d7-3518-4d60-97f4-37616edbfc93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c222d31ec51848279de98269d6837905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:22Z,use_quota=True,user_id='08f9986f124e440a84f9020544ba598f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Creating volume 208d81d7-3518-4d60-97f4-37616edbfc93 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:06:22 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:06:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-208d81d7-3518-4d60-97f4-37616edbfc93 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:22 devstack sudo[95201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-208d81d7-3518-4d60-97f4-37616edbfc93 1073741824 Sep 28 16:06:22 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] Acquiring lock "cinder-cb64979b-3c83-4ca3-a50e-6dbcf1cac138-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:23 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-cb64979b-3c83-4ca3-a50e-6dbcf1cac138-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-208d81d7-3518-4d60-97f4-37616edbfc93 1073741824" returned: 0 in 0.961s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-208d81d7-3518-4d60-97f4-37616edbfc93 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] Acquiring lock "cinder-quobyte-cb64979b-3c83-4ca3-a50e-6dbcf1cac138" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:23 devstack sudo[95206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-208d81d7-3518-4d60-97f4-37616edbfc93 Sep 28 16:06:23 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-quobyte-cb64979b-3c83-4ca3-a50e-6dbcf1cac138" acquired by "delete_volume" :: waited 0.068s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:23 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b3d9f7-e6bd-4efd-8b20-b33698a3fcfa]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:23 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138 Sep 28 16:06:23 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:24 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-208d81d7-3518-4d60-97f4-37616edbfc93" returned: 0 in 0.716s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:06:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f6ec06-cf74-4d31-bcb8-4996515ffe23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208d81d7-3518-4d60-97f4-37616edbfc93', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58786b5-90f1-4374-9f2e-4136db2a4e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:24 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Volume volume-208d81d7-3518-4d60-97f4-37616edbfc93 (208d81d7-3518-4d60-97f4-37616edbfc93): created successfully Sep 28 16:06:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58786b5-90f1-4374-9f2e-4136db2a4e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Flow 'volume_create_manager' (0580d6a5-1c12-40fb-8e4c-8b2de998853c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5466fd6d-50f8-492e-92f4-85a4c5082110 tempest-AttachVolumeNegativeTest-429818067 None] Created volume successfully. Sep 28 16:06:24 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138" returned: 0 in 1.006s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:24 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138 Sep 28 16:06:24 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:25 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb64979b-3c83-4ca3-a50e-6dbcf1cac138" returned: 0 in 0.687s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-quobyte-cb64979b-3c83-4ca3-a50e-6dbcf1cac138" released by "delete_volume" :: held 1.877s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:25 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] Created reservations ['e9c53f7d-1754-4ab0-9ac7-03be12141157', '9233a5e4-3ede-4890-a077-dc7b5cd1b067', 'bca3ce12-597c-4b10-bd21-77e6ee684224', '8f711a57-8ee6-4083-ba51-67a546b9c9bc'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Flow 'volume_create_manager' (0913dc69-a19c-41dc-b94d-c53798b08ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430bbf14-8d7d-482a-b2cd-5e2233ea0909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430bbf14-8d7d-482a-b2cd-5e2233ea0909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1863102251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f76013d-c891-4c46-b60d-e430819c510e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31750b78f5d4dfb9c99f7e3be48864f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:26Z,use_quota=True,user_id='0023b71b22d147a98d89b9a861a58369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a4c8c2f-1804-4554-b7ff-1833083032cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a4c8c2f-1804-4554-b7ff-1833083032cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe5029c-ddcb-4881-bd0e-17624d73822f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe5029c-ddcb-4881-bd0e-17624d73822f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f76013d-c891-4c46-b60d-e430819c510e', 'volume_name': 'volume-4f76013d-c891-4c46-b60d-e430819c510e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6c96ba-e7bd-4fbf-8f47-2030d835f843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6c96ba-e7bd-4fbf-8f47-2030d835f843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e6c28c-f481-4a07-ace4-bd1bca89e3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:26 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Volume 4f76013d-c891-4c46-b60d-e430819c510e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f76013d-c891-4c46-b60d-e430819c510e', 'volume_size': 1} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1863102251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f76013d-c891-4c46-b60d-e430819c510e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31750b78f5d4dfb9c99f7e3be48864f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:26Z,use_quota=True,user_id='0023b71b22d147a98d89b9a861a58369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Creating volume 4f76013d-c891-4c46-b60d-e430819c510e {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:06:26 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f76013d-c891-4c46-b60d-e430819c510e 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:26 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f76013d-c891-4c46-b60d-e430819c510e 1073741824 Sep 28 16:06:26 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:26 devstack sudo[95246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:06:26 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:27 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.847s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:27 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:06:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] Deleted volume successfully. Sep 28 16:06:27 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f76013d-c891-4c46-b60d-e430819c510e 1073741824" returned: 0 in 1.056s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-31d7f329-9d87-4293-a56b-f141b6b68652 tempest-VolumesSnapshotListTestJSON-1682736709 None] Lock "cinder-cb64979b-3c83-4ca3-a50e-6dbcf1cac138-delete_volume" released by "delete_volume" :: held 4.158s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-effca3a4-5b10-4062-8ffc-2d6f62c0cf6e req-54502be7-95a3-4a4c-8912-287baf12afb1 tempest-AttachVolumeNegativeTest-429818067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f76013d-c891-4c46-b60d-e430819c510e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:27 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f76013d-c891-4c46-b60d-e430819c510e Sep 28 16:06:27 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:27 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f76013d-c891-4c46-b60d-e430819c510e" returned: 0 in 0.417s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:06:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-effca3a4-5b10-4062-8ffc-2d6f62c0cf6e req-54502be7-95a3-4a4c-8912-287baf12afb1 tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.461s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-effca3a4-5b10-4062-8ffc-2d6f62c0cf6e req-54502be7-95a3-4a4c-8912-287baf12afb1 tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e6c28c-f481-4a07-ace4-bd1bca89e3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f76013d-c891-4c46-b60d-e430819c510e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7faffb2-72ba-4e2e-b6ad-b1daa23eddd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:27 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Volume volume-4f76013d-c891-4c46-b60d-e430819c510e (4f76013d-c891-4c46-b60d-e430819c510e): created successfully Sep 28 16:06:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7faffb2-72ba-4e2e-b6ad-b1daa23eddd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Flow 'volume_create_manager' (0913dc69-a19c-41dc-b94d-c53798b08ffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:28 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1e8ed407-f1e8-43bf-81b6-f169077db7cb tempest-ServerRescueNegativeTestJSON-803652980 None] Created volume successfully. Sep 28 16:06:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-effca3a4-5b10-4062-8ffc-2d6f62c0cf6e req-54502be7-95a3-4a4c-8912-287baf12afb1 tempest-AttachVolumeNegativeTest-429818067 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-208d81d7-3518-4d60-97f4-37616edbfc93', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '027cc335-6979-4467-9302-61744db62010', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:06:28 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-effca3a4-5b10-4062-8ffc-2d6f62c0cf6e req-54502be7-95a3-4a4c-8912-287baf12afb1 tempest-AttachVolumeNegativeTest-429818067 None] attachment_update completed successfully. Sep 28 16:06:34 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:06:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:35 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:06:35 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:35 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.784s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:06:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:06:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:06:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Flow 'volume_create_manager' (22ce134d-bc76-411c-a55c-34b03527a818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c9a894-a895-4bb4-b590-64a0529c5146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c9a894-a895-4bb4-b590-64a0529c5146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2030035804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=630768f2-8bd8-47f4-aba2-fb6a9f625536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9ea9fd07a4a4982ac8308362f7d04d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:36Z,use_quota=True,user_id='9592cb8dc8b64426aca85b783825c81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff3cc59-9420-4838-a978-e2af096c3ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff3cc59-9420-4838-a978-e2af096c3ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e4bca5-92c7-4354-8788-7602347844ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e4bca5-92c7-4354-8788-7602347844ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '630768f2-8bd8-47f4-aba2-fb6a9f625536', 'volume_name': 'volume-630768f2-8bd8-47f4-aba2-fb6a9f625536', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44324a2e-14f8-4251-bf55-1651103d80eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44324a2e-14f8-4251-bf55-1651103d80eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20cade76-0df0-4292-9fbd-ad40372d1ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:36 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Volume 630768f2-8bd8-47f4-aba2-fb6a9f625536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-630768f2-8bd8-47f4-aba2-fb6a9f625536', 'volume_size': 1} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2030035804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=630768f2-8bd8-47f4-aba2-fb6a9f625536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9ea9fd07a4a4982ac8308362f7d04d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:36Z,use_quota=True,user_id='9592cb8dc8b64426aca85b783825c81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Creating volume 630768f2-8bd8-47f4-aba2-fb6a9f625536 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:06:36 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Flow 'volume_create_manager' (ae694647-a700-4e6b-9179-dd484a49f2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:36 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 1073741824 Sep 28 16:06:36 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab74bf1d-3951-499f-bc48-c2440eed4860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab74bf1d-3951-499f-bc48-c2440eed4860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1753271631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b6846f-ecde-4518-82f7-0a25c9957234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04ee0798949457095e321931bf75250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:36Z,use_quota=True,user_id='127f35aa020341ff95be8fa72c6eb254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04338012-c477-451d-ac09-8bffe38979e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04338012-c477-451d-ac09-8bffe38979e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3edb396a-8337-4cf7-ad47-5bc23f226dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3edb396a-8337-4cf7-ad47-5bc23f226dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b6846f-ecde-4518-82f7-0a25c9957234', 'volume_name': 'volume-12b6846f-ecde-4518-82f7-0a25c9957234', 'volume_size': 2}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104073b3-671e-42ee-bab1-e80f28b6665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104073b3-671e-42ee-bab1-e80f28b6665e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8ad022-7e97-4e86-a9da-9d5fd8a4f4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:36 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Volume 12b6846f-ecde-4518-82f7-0a25c9957234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b6846f-ecde-4518-82f7-0a25c9957234', 'volume_size': 2} Sep 28 16:06:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:37 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 1073741824" returned: 0 in 0.954s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:37 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 Sep 28 16:06:37 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:38 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536" returned: 0 in 0.487s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:06:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.291s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1753271631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b6846f-ecde-4518-82f7-0a25c9957234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04ee0798949457095e321931bf75250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:36Z,use_quota=True,user_id='127f35aa020341ff95be8fa72c6eb254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:06:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Creating volume 12b6846f-ecde-4518-82f7-0a25c9957234 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:06:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:06:38 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:06:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234 2147483648 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20cade76-0df0-4292-9fbd-ad40372d1ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-630768f2-8bd8-47f4-aba2-fb6a9f625536', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4c721b-5be5-4e0f-8aab-c990cc3d2bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:38 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234 2147483648 Sep 28 16:06:38 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:38 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Volume volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 (630768f2-8bd8-47f4-aba2-fb6a9f625536): created successfully Sep 28 16:06:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4c721b-5be5-4e0f-8aab-c990cc3d2bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Flow 'volume_create_manager' (22ce134d-bc76-411c-a55c-34b03527a818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:38 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b5a4310e-1899-441b-8160-44dd863d5367 tempest-VolumesActionsTest-97612136 None] Created volume successfully. Sep 28 16:06:38 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234 2147483648" returned: 0 in 0.759s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:39 devstack sudo[95791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234 Sep 28 16:06:39 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:39 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234" returned: 0 in 0.552s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:06:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8ad022-7e97-4e86-a9da-9d5fd8a4f4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b6846f-ecde-4518-82f7-0a25c9957234', 'volume_size': 2}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd73e02-739e-4236-9220-41094acb890f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:39 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Volume volume-12b6846f-ecde-4518-82f7-0a25c9957234 (12b6846f-ecde-4518-82f7-0a25c9957234): created successfully Sep 28 16:06:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd73e02-739e-4236-9220-41094acb890f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Flow 'volume_create_manager' (ae694647-a700-4e6b-9179-dd484a49f2b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4aad98f6-c10a-4b15-aac1-4b3624dd6f29 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Created volume successfully. Sep 28 16:06:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3a72d1be-5ebe-48cc-b016-73254d3c14bf tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3a72d1be-5ebe-48cc-b016-73254d3c14bf tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3a72d1be-5ebe-48cc-b016-73254d3c14bf tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Creating offline snapshot fd29330e-cdd8-4111-8ece-10e70215a6dc of volume 12b6846f-ecde-4518-82f7-0a25c9957234 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:06:40 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5ae500-94da-4dac-a708-2d36a0f0a947]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a72d1be-5ebe-48cc-b016-73254d3c14bf tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:41 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234 Sep 28 16:06:41 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:41 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a72d1be-5ebe-48cc-b016-73254d3c14bf tempest-VolumesSnapshotNegativeTestJSON-692458897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234" returned: 0 in 0.827s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a72d1be-5ebe-48cc-b016-73254d3c14bf tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc 2G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:41 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc 2G Sep 28 16:06:41 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:42 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a72d1be-5ebe-48cc-b016-73254d3c14bf tempest-VolumesSnapshotNegativeTestJSON-692458897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc 2G" returned: 0 in 0.770s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a72d1be-5ebe-48cc-b016-73254d3c14bf tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b6846f-ecde-4518-82f7-0a25c9957234 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:42 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b6846f-ecde-4518-82f7-0a25c9957234 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc Sep 28 16:06:42 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:42 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a72d1be-5ebe-48cc-b016-73254d3c14bf tempest-VolumesSnapshotNegativeTestJSON-692458897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b6846f-ecde-4518-82f7-0a25c9957234 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc" returned: 0 in 0.478s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:43 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-3a72d1be-5ebe-48cc-b016-73254d3c14bf tempest-VolumesSnapshotNegativeTestJSON-692458897 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc is being set with open permissions: ugo+rw Sep 28 16:06:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a72d1be-5ebe-48cc-b016-73254d3c14bf tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:43 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc Sep 28 16:06:43 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:43 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a72d1be-5ebe-48cc-b016-73254d3c14bf tempest-VolumesSnapshotNegativeTestJSON-692458897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc" returned: 0 in 0.439s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a72d1be-5ebe-48cc-b016-73254d3c14bf tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:43 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.info Sep 28 16:06:43 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:44 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a72d1be-5ebe-48cc-b016-73254d3c14bf tempest-VolumesSnapshotNegativeTestJSON-692458897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.info" returned: 0 in 0.589s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:44 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-3a72d1be-5ebe-48cc-b016-73254d3c14bf tempest-VolumesSnapshotNegativeTestJSON-692458897 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.info is being set with open permissions: ugo+rw Sep 28 16:06:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a72d1be-5ebe-48cc-b016-73254d3c14bf tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:44 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.info Sep 28 16:06:44 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:44 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a72d1be-5ebe-48cc-b016-73254d3c14bf tempest-VolumesSnapshotNegativeTestJSON-692458897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.info" returned: 0 in 0.608s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3a72d1be-5ebe-48cc-b016-73254d3c14bf tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.967s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:44 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3a72d1be-5ebe-48cc-b016-73254d3c14bf tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Create snapshot completed successfully Sep 28 16:06:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Acquiring lock "cinder-fd29330e-cdd8-4111-8ece-10e70215a6dc-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Lock "cinder-fd29330e-cdd8-4111-8ece-10e70215a6dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Acquiring lock "cinder-quobyte-12b6846f-ecde-4518-82f7-0a25c9957234" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Lock "cinder-quobyte-12b6846f-ecde-4518-82f7-0a25c9957234" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Acquiring lock "cinder-quobyte-fd29330e-cdd8-4111-8ece-10e70215a6dc" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Lock "cinder-quobyte-fd29330e-cdd8-4111-8ece-10e70215a6dc" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Deleting offline snapshot fd29330e-cdd8-4111-8ece-10e70215a6dc of volume 12b6846f-ecde-4518-82f7-0a25c9957234 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:06:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] snapshot_file for this snap is: volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:06:45 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2667d0d-10c7-4dff-9018-af49f4e432df]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:45 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc Sep 28 16:06:45 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:46 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc" returned: 0 in 0.930s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12b6846f-ecde-4518-82f7-0a25c9957234(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:06:46 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05fddf4-e549-4daa-bac7-0da6c8491bdb]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:46 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234 Sep 28 16:06:46 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:47 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234" returned: 0 in 0.648s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:47 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc Sep 28 16:06:47 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] Acquiring lock "cinder-4f76013d-c891-4c46-b60d-e430819c510e-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] Lock "cinder-4f76013d-c891-4c46-b60d-e430819c510e-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] Acquiring lock "cinder-quobyte-4f76013d-c891-4c46-b60d-e430819c510e" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] Lock "cinder-quobyte-4f76013d-c891-4c46-b60d-e430819c510e" acquired by "delete_volume" :: waited 0.043s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:48 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[73aa7f46-1f09-4d54-9dbd-481bcaf209c4]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f76013d-c891-4c46-b60d-e430819c510e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:48 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc" returned: 0 in 0.996s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:48 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f76013d-c891-4c46-b60d-e430819c510e Sep 28 16:06:48 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:48 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc Sep 28 16:06:48 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:48 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f76013d-c891-4c46-b60d-e430819c510e" returned: 0 in 0.844s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f76013d-c891-4c46-b60d-e430819c510e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:48 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f76013d-c891-4c46-b60d-e430819c510e Sep 28 16:06:48 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:48 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234.fd29330e-cdd8-4111-8ece-10e70215a6dc" returned: 0 in 0.734s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Lock "cinder-quobyte-fd29330e-cdd8-4111-8ece-10e70215a6dc" released by "_delete_snapshot" :: held 3.663s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Lock "cinder-quobyte-12b6846f-ecde-4518-82f7-0a25c9957234" released by "delete_snapshot" :: held 3.748s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:49 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Created reservations ['c79b0a1e-667e-43ea-b016-fb28beba8192', '632ad5a6-8708-4f88-b592-f4014a99a654', 'b59fc654-729c-44fc-9f1b-f3e32ae6da60', '98e9714a-f0d1-46c9-ad0c-387746014952'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:06:49 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f76013d-c891-4c46-b60d-e430819c510e" returned: 0 in 0.878s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Delete snapshot completed successfully. Sep 28 16:06:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] Lock "cinder-quobyte-4f76013d-c891-4c46-b60d-e430819c510e" released by "delete_volume" :: held 1.848s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1f5a3f99-83e7-4bf0-9634-e77c562291a5 tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Lock "cinder-fd29330e-cdd8-4111-8ece-10e70215a6dc-delete_snapshot" released by "delete_snapshot" :: held 4.496s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:49 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] Created reservations ['7377d02d-98a6-4516-8551-46f0f563ef6a', 'c6bcc575-cca7-4e1a-ab7c-6d730a37e7e8', '88b88a0c-fbf0-4065-a242-fb8b07cbc283', '63cfd82b-b845-46c5-aa0c-7de86b99f661'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:06:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:50 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:06:50 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Acquiring lock "cinder-12b6846f-ecde-4518-82f7-0a25c9957234-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Lock "cinder-12b6846f-ecde-4518-82f7-0a25c9957234-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Acquiring lock "cinder-quobyte-12b6846f-ecde-4518-82f7-0a25c9957234" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Lock "cinder-quobyte-12b6846f-ecde-4518-82f7-0a25c9957234" acquired by "delete_volume" :: waited 0.036s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:50 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02f3f60-ee80-4a74-ab41-57bf443523cf]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:50 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.847s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:50 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:06:51 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] Deleted volume successfully. Sep 28 16:06:51 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234 Sep 28 16:06:51 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0e2f22c-22e7-4c48-bcf0-dda7a5576ebc tempest-ServerRescueNegativeTestJSON-803652980 None] Lock "cinder-4f76013d-c891-4c46-b60d-e430819c510e-delete_volume" released by "delete_volume" :: held 3.224s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:52 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234" returned: 0 in 1.549s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:52 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234 Sep 28 16:06:52 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:52 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-12b6846f-ecde-4518-82f7-0a25c9957234" returned: 0 in 0.597s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Lock "cinder-quobyte-12b6846f-ecde-4518-82f7-0a25c9957234" released by "delete_volume" :: held 2.360s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:52 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Created reservations ['0ed6d267-5f8d-475f-8245-8878d75b1ffd', 'df7bdea8-dac6-46b0-9f99-23a94ed20d4c', '3e9439e8-4527-4691-8c5f-b86a7fa355e8', '0d41273e-e7b9-4df5-9470-57deb69fec10'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:06:53 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=54,cinder:UPDATE=70,cinder:INSERT=17,cinder:DELETE=7 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:06:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:53 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:06:53 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:53 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.725s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:06:54 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Deleted volume successfully. Sep 28 16:06:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-572c1ef9-bab2-4e19-81ac-8e197804ea9d tempest-VolumesSnapshotNegativeTestJSON-692458897 None] Lock "cinder-12b6846f-ecde-4518-82f7-0a25c9957234-delete_volume" released by "delete_volume" :: held 3.699s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3c88dafc-67ff-423a-907b-19ff63e0e4be tempest-VolumesActionsTest-97612136 None] Acquiring lock "cinder-630768f2-8bd8-47f4-aba2-fb6a9f625536" by "attach_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3c88dafc-67ff-423a-907b-19ff63e0e4be tempest-VolumesActionsTest-97612136 None] Lock "cinder-630768f2-8bd8-47f4-aba2-fb6a9f625536" acquired by "attach_volume" :: waited 0.052s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:00 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=67,cinder:DELETE=4,cinder:UPDATE=59,cinder:INSERT=18 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:07:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3c88dafc-67ff-423a-907b-19ff63e0e4be tempest-VolumesActionsTest-97612136 None] Attaching volume 630768f2-8bd8-47f4-aba2-fb6a9f625536 to instance 3e1aae94-4c58-40fe-83fa-c622323ec265 at mountpoint /dev/vdb on host None. Sep 28 16:07:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3c88dafc-67ff-423a-907b-19ff63e0e4be tempest-VolumesActionsTest-97612136 None] Attach volume completed successfully. Sep 28 16:07:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3c88dafc-67ff-423a-907b-19ff63e0e4be tempest-VolumesActionsTest-97612136 None] Lock "cinder-630768f2-8bd8-47f4-aba2-fb6a9f625536" released by "attach_volume" :: held 0.393s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-16755e54-1ca8-4a8e-b20e-850338b4cde5 tempest-VolumesActionsTest-97612136 None] Acquiring lock "cinder-630768f2-8bd8-47f4-aba2-fb6a9f625536-detach_volume" by "detach_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-16755e54-1ca8-4a8e-b20e-850338b4cde5 tempest-VolumesActionsTest-97612136 None] Lock "cinder-630768f2-8bd8-47f4-aba2-fb6a9f625536-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:01 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-16755e54-1ca8-4a8e-b20e-850338b4cde5 tempest-VolumesActionsTest-97612136 None] Detaching volume 630768f2-8bd8-47f4-aba2-fb6a9f625536 from instance 3e1aae94-4c58-40fe-83fa-c622323ec265. Sep 28 16:07:01 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-16755e54-1ca8-4a8e-b20e-850338b4cde5 tempest-VolumesActionsTest-97612136 None] Detach volume completed successfully. Sep 28 16:07:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-16755e54-1ca8-4a8e-b20e-850338b4cde5 tempest-VolumesActionsTest-97612136 None] Lock "cinder-630768f2-8bd8-47f4-aba2-fb6a9f625536-detach_volume" released by "detach_volume" :: held 0.236s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:11 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:07:11 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:07:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-95679950-e289-47bc-be47-4efaca4fc9b7 tempest-GroupSnapshotsTest-696468924 None] Group tempest-GroupSnapshotsTest-Group-1202129069: creating Sep 28 16:07:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-95679950-e289-47bc-be47-4efaca4fc9b7 tempest-GroupSnapshotsTest-696468924 None] Group tempest-GroupSnapshotsTest-Group-1202129069: created successfully Sep 28 16:07:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-95679950-e289-47bc-be47-4efaca4fc9b7 tempest-GroupSnapshotsTest-696468924 None] Create group completed successfully. Sep 28 16:07:26 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:07:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Flow 'volume_create_manager' (738d90e8-e1b2-40e8-8932-2998d2dafb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:07:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8f9c1f-09cd-47ab-8c3e-2688f955ecd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8f9c1f-09cd-47ab-8c3e-2688f955ecd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2127496592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bdaad1eb-9b02-44d6-a2aa-510a935276df,host='devstack@QuobyteHD#QuobyteHD',id=82be997e-c24c-4aa4-9a69-46463ec047d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d92cb2b55a49a7b66431db4a34a3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:07:26Z,use_quota=True,user_id='0180a068d2ce428a870f66da4ddd4f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32d69c64-98e6-4078-91df-c5d38aacd99c),volume_type_id=32d69c64-98e6-4078-91df-c5d38aacd99c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bf2c36-1b0d-4285-bfcf-a4777a9477e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bf2c36-1b0d-4285-bfcf-a4777a9477e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad1cafd-80e9-4bb8-a328-a9785ea39c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad1cafd-80e9-4bb8-a328-a9785ea39c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82be997e-c24c-4aa4-9a69-46463ec047d0', 'volume_name': 'volume-82be997e-c24c-4aa4-9a69-46463ec047d0', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3517c0-a539-4002-bbca-040347ebe8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3517c0-a539-4002-bbca-040347ebe8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895216d5-d2b1-4943-bcdd-19d4e5eea5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:27 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Volume 82be997e-c24c-4aa4-9a69-46463ec047d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82be997e-c24c-4aa4-9a69-46463ec047d0', 'volume_size': 1} Sep 28 16:07:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bdaad1eb-9b02-44d6-a2aa-510a935276df,created_at=2026-09-28T14:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2127496592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bdaad1eb-9b02-44d6-a2aa-510a935276df,host='devstack@QuobyteHD#QuobyteHD',id=82be997e-c24c-4aa4-9a69-46463ec047d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d92cb2b55a49a7b66431db4a34a3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:07:26Z,use_quota=True,user_id='0180a068d2ce428a870f66da4ddd4f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32d69c64-98e6-4078-91df-c5d38aacd99c),volume_type_id=32d69c64-98e6-4078-91df-c5d38aacd99c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:07:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Creating volume 82be997e-c24c-4aa4-9a69-46463ec047d0 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:07:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:07:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:07:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:07:27 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:07:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:27 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0 1073741824 Sep 28 16:07:27 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:27 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0 1073741824" returned: 0 in 0.944s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:28 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0 Sep 28 16:07:28 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:28 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0" returned: 0 in 0.630s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:07:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895216d5-d2b1-4943-bcdd-19d4e5eea5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82be997e-c24c-4aa4-9a69-46463ec047d0', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b6e20a-c704-425c-a591-c0ea4b0084a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:28 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Volume volume-82be997e-c24c-4aa4-9a69-46463ec047d0 (82be997e-c24c-4aa4-9a69-46463ec047d0): created successfully Sep 28 16:07:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b6e20a-c704-425c-a591-c0ea4b0084a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Flow 'volume_create_manager' (738d90e8-e1b2-40e8-8932-2998d2dafb3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:07:28 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7971c85b-d172-4aa7-9b74-8e9bc3631112 tempest-GroupSnapshotsTest-696468924 None] Created volume successfully. Sep 28 16:07:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6c131192-803c-4c7d-8a6c-1572c936b5c9 tempest-VolumesActionsTest-97612136 None] Acquiring lock "cinder-630768f2-8bd8-47f4-aba2-fb6a9f625536" by "attach_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6c131192-803c-4c7d-8a6c-1572c936b5c9 tempest-VolumesActionsTest-97612136 None] Lock "cinder-630768f2-8bd8-47f4-aba2-fb6a9f625536" acquired by "attach_volume" :: waited 0.048s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6c131192-803c-4c7d-8a6c-1572c936b5c9 tempest-VolumesActionsTest-97612136 None] Attaching volume 630768f2-8bd8-47f4-aba2-fb6a9f625536 to instance 6d9fd6ea-70fc-4f29-8c35-06d0e466f66b at mountpoint /dev/vdb on host None. Sep 28 16:07:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6c131192-803c-4c7d-8a6c-1572c936b5c9 tempest-VolumesActionsTest-97612136 None] Attach volume completed successfully. Sep 28 16:07:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6c131192-803c-4c7d-8a6c-1572c936b5c9 tempest-VolumesActionsTest-97612136 None] Lock "cinder-630768f2-8bd8-47f4-aba2-fb6a9f625536" released by "attach_volume" :: held 0.232s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ee05f337-1c03-4da9-9c21-f694cb9ace37 tempest-VolumesActionsTest-97612136 None] Acquiring lock "cinder-630768f2-8bd8-47f4-aba2-fb6a9f625536-detach_volume" by "detach_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ee05f337-1c03-4da9-9c21-f694cb9ace37 tempest-VolumesActionsTest-97612136 None] Lock "cinder-630768f2-8bd8-47f4-aba2-fb6a9f625536-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ee05f337-1c03-4da9-9c21-f694cb9ace37 tempest-VolumesActionsTest-97612136 None] Detaching volume 630768f2-8bd8-47f4-aba2-fb6a9f625536 from instance 6d9fd6ea-70fc-4f29-8c35-06d0e466f66b. Sep 28 16:07:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ee05f337-1c03-4da9-9c21-f694cb9ace37 tempest-VolumesActionsTest-97612136 None] Detach volume completed successfully. Sep 28 16:07:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ee05f337-1c03-4da9-9c21-f694cb9ace37 tempest-VolumesActionsTest-97612136 None] Lock "cinder-630768f2-8bd8-47f4-aba2-fb6a9f625536-detach_volume" released by "detach_volume" :: held 0.148s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] GroupSnapshot 5f36d870-a170-4ffb-9ee3-a85c6b700a68: creating. Sep 28 16:07:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] Group snapshot 5f36d870-a170-4ffb-9ee3-a85c6b700a68: creating. {{(pid=87087) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 16:07:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] Creating offline snapshot c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 of volume 82be997e-c24c-4aa4-9a69-46463ec047d0 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:07:30 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96f00f4-f80f-41e6-9eea-dbd8becc11a5]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:31 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0 Sep 28 16:07:31 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:31 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0" returned: 0 in 0.673s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:31 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 1G Sep 28 16:07:31 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:32 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 1G" returned: 0 in 0.722s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82be997e-c24c-4aa4-9a69-46463ec047d0 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:32 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82be997e-c24c-4aa4-9a69-46463ec047d0 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 Sep 28 16:07:32 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:32 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82be997e-c24c-4aa4-9a69-46463ec047d0 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06" returned: 0 in 0.435s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:32 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:07:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:32 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 Sep 28 16:07:32 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:33 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06" returned: 0 in 0.290s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:33 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.info Sep 28 16:07:33 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:33 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.info" returned: 0 in 0.399s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:33 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:07:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:33 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.info Sep 28 16:07:33 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:33 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.info" returned: 0 in 0.398s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.094s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:34 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c0f9d72f-f2a5-463d-8f4a-818d69ecf2e8 tempest-GroupSnapshotsTest-696468924 None] group_snapshot 5f36d870-a170-4ffb-9ee3-a85c6b700a68: created successfully Sep 28 16:07:34 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:07:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:07:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:07:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:35 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:07:35 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:35 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-421df107-32a4-403a-84f5-0177c58fc202 req-f849cdbd-462e-4a72-b577-8bcb7e81b370 tempest-AttachVolumeNegativeTest-429818067 None] Terminate volume connection completed successfully. Sep 28 16:07:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-421df107-32a4-403a-84f5-0177c58fc202 req-f849cdbd-462e-4a72-b577-8bcb7e81b370 tempest-AttachVolumeNegativeTest-429818067 None] Deleting attachment 027cc335-6979-4467-9302-61744db62010. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:07:35 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.656s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:07:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:07:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:07:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:07:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "cinder-quobyte-c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06-693f200e-500d-44d4-bf1b-0032223f0d9e" by "_create_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06-693f200e-500d-44d4-bf1b-0032223f0d9e" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Creating volume 693f200e-500d-44d4-bf1b-0032223f0d9e from snapshot c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 {{(pid=87087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:07:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:07:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:07:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:07:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "cinder-quobyte-693f200e-500d-44d4-bf1b-0032223f0d9e" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-693f200e-500d-44d4-bf1b-0032223f0d9e" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] snapshot: c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06, volume: 693f200e-500d-44d4-bf1b-0032223f0d9e, {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:07:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:07:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:07:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cc0c4c-ca1b-43ad-b4e5-1cfb8d509901]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:37 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 Sep 28 16:07:37 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:37 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06" returned: 0 in 0.788s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82be997e-c24c-4aa4-9a69-46463ec047d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:07:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5438951f-d2ea-4b01-8258-c1654ca4bf69]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:38 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0 Sep 28 16:07:38 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:38 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:07:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Flow 'volume_create_manager' (ac0389d7-fd73-4a84-8915-d6987000d85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:07:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e877e6a-3832-436d-a2a2-f0256ccf1659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e877e6a-3832-436d-a2a2-f0256ccf1659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1492325936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0418f2-c3e5-40c8-850d-95f7ab4579b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1644f00bb40f4ef3a3a19e18c4efa0af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:07:38Z,use_quota=True,user_id='662929938eab40beb479ec1dcab1ef96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93caa77-9917-4521-ad84-1ee078d3305b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93caa77-9917-4521-ad84-1ee078d3305b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb98625-6f67-460f-b31a-a2445985a644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb98625-6f67-460f-b31a-a2445985a644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b0418f2-c3e5-40c8-850d-95f7ab4579b5', 'volume_name': 'volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a94837-d4ca-42e9-861e-078bd1f20cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a94837-d4ca-42e9-861e-078bd1f20cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca6d457-2efe-4deb-9a77-ef0842d049e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:38 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Volume 4b0418f2-c3e5-40c8-850d-95f7ab4579b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5', 'volume_size': 1} Sep 28 16:07:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:38 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0" returned: 0 in 0.566s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0 {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:07:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:07:38 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Path /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-693f200e-500d-44d4-bf1b-0032223f0d9e not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:07:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-693f200e-500d-44d4-bf1b-0032223f0d9e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:38 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-693f200e-500d-44d4-bf1b-0032223f0d9e Sep 28 16:07:38 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0d5f8c18-62cd-45ae-b64a-26406372f780 tempest-VolumesActionsTest-97612136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:46 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-693f200e-500d-44d4-bf1b-0032223f0d9e" returned: 0 in 7.927s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:46 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0, size 1024.00 MB, duration 7.93 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-693f200e-500d-44d4-bf1b-0032223f0d9e {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:07:46 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Converted 1024.00 MB image at 129.15 MB/s Sep 28 16:07:46 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-693f200e-500d-44d4-bf1b-0032223f0d9e is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:07:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-693f200e-500d-44d4-bf1b-0032223f0d9e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:46 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-693f200e-500d-44d4-bf1b-0032223f0d9e Sep 28 16:07:46 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:46 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-693f200e-500d-44d4-bf1b-0032223f0d9e" returned: 0 in 0.291s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-693f200e-500d-44d4-bf1b-0032223f0d9e" released by "_copy_volume_from_snapshot" :: held 9.759s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06-693f200e-500d-44d4-bf1b-0032223f0d9e" released by "_create_volume_from_snapshot" :: held 9.873s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.931s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.444s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1492325936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0418f2-c3e5-40c8-850d-95f7ab4579b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1644f00bb40f4ef3a3a19e18c4efa0af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:07:38Z,use_quota=True,user_id='662929938eab40beb479ec1dcab1ef96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:07:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Creating volume 4b0418f2-c3e5-40c8-850d-95f7ab4579b5 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:07:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:07:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:07:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:07:46 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:07:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:46 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5 1073741824 Sep 28 16:07:46 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2fbed76b-0570-4891-a61b-b999784f7164 tempest-GroupSnapshotsTest-696468924 None] Create group from source-snapshot-5f36d870-a170-4ffb-9ee3-a85c6b700a68 completed successfully. Sep 28 16:07:47 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5 1073741824" returned: 0 in 0.675s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:47 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5 Sep 28 16:07:47 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "cinder-quobyte-693f200e-500d-44d4-bf1b-0032223f0d9e" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-693f200e-500d-44d4-bf1b-0032223f0d9e" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:47 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[137a8c77-880d-4734-a15e-ca84326633ef]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-693f200e-500d-44d4-bf1b-0032223f0d9e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:47 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5" returned: 0 in 0.326s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:07:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0d5f8c18-62cd-45ae-b64a-26406372f780 tempest-VolumesActionsTest-97612136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 8.208s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca6d457-2efe-4deb-9a77-ef0842d049e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a5c03b-6f2a-48f6-81f0-6f4e4b3a587d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:47 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa652e80-d3bf-45b2-9c77-1038c9935e15]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d5f8c18-62cd-45ae-b64a-26406372f780 tempest-VolumesActionsTest-97612136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:47 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Volume volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5 (4b0418f2-c3e5-40c8-850d-95f7ab4579b5): created successfully Sep 28 16:07:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a5c03b-6f2a-48f6-81f0-6f4e4b3a587d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Flow 'volume_create_manager' (ac0389d7-fd73-4a84-8915-d6987000d85b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:07:47 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-693f200e-500d-44d4-bf1b-0032223f0d9e Sep 28 16:07:47 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b1f4ab9d-8066-4faa-8f3d-29e61805938c tempest-TestImageHashVerification-144809291 None] Created volume successfully. Sep 28 16:07:48 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 Sep 28 16:07:48 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:48 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-693f200e-500d-44d4-bf1b-0032223f0d9e" returned: 0 in 0.560s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-693f200e-500d-44d4-bf1b-0032223f0d9e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:48 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-693f200e-500d-44d4-bf1b-0032223f0d9e Sep 28 16:07:48 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:48 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d5f8c18-62cd-45ae-b64a-26406372f780 tempest-VolumesActionsTest-97612136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536" returned: 0 in 0.692s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:48 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca9f75e-ff0a-4599-8ef6-780b87ea5eec]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d5f8c18-62cd-45ae-b64a-26406372f780 tempest-VolumesActionsTest-97612136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:48 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-693f200e-500d-44d4-bf1b-0032223f0d9e" returned: 0 in 0.342s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-693f200e-500d-44d4-bf1b-0032223f0d9e" released by "delete_volume" :: held 0.985s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:48 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 Sep 28 16:07:48 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:48 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] Created reservations ['5d6afe78-efd1-40ff-a818-4b626db8046c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:07:48 devstack cinder-volume[87087]: WARNING cinder.quota [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1578073730 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1578073730, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:07:48 devstack cinder-volume[87087]: WARNING cinder.quota [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1578073730 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1578073730, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:07:48 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] Created reservations ['c7b36ff0-36ca-4d45-be21-ab8b698f0da4', 'd121e6a5-0660-43ca-ab77-27372b278a7d', '26aa7763-9b6f-451e-8100-f84c1b758a61', '1cffa023-7ec9-4ce4-8ac5-c7f298f1c159'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:49 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:07:49 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:49 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d5f8c18-62cd-45ae-b64a-26406372f780 tempest-VolumesActionsTest-97612136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536" returned: 0 in 0.605s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d5f8c18-62cd-45ae-b64a-26406372f780 tempest-VolumesActionsTest-97612136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 /opt/stack/data/cinder/conversion/630768f2-8bd8-47f4-aba2-fb6a9f625536.temp_image.7d6943e1-0f9b-4023-a028-31d091a16c60yb9ocybk.img {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:49 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 /opt/stack/data/cinder/conversion/630768f2-8bd8-47f4-aba2-fb6a9f625536.temp_image.7d6943e1-0f9b-4023-a028-31d091a16c60yb9ocybk.img Sep 28 16:07:49 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] group_snapshot 5f36d870-a170-4ffb-9ee3-a85c6b700a68: deleting Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] group_snapshot 5f36d870-a170-4ffb-9ee3-a85c6b700a68: deleting {{(pid=87087) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "cinder-quobyte-82be997e-c24c-4aa4-9a69-46463ec047d0" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-82be997e-c24c-4aa4-9a69-46463ec047d0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "cinder-quobyte-c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] Deleting offline snapshot c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 of volume 82be997e-c24c-4aa4-9a69-46463ec047d0 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] snapshot_file for this snap is: volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5ee256-4224-41b9-89de-4e4afa7ce41b]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:49 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.528s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:07:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-df6a0110-3120-43f7-b441-27b5b6a0c30a tempest-GroupSnapshotsTest-696468924 None] Delete group completed successfully. Sep 28 16:07:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-459672fc-08ed-4f27-8257-fadb382de9a9 tempest-TestImageHashVerification-144809291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:49 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 Sep 28 16:07:49 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:50 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06" returned: 0 in 0.842s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82be997e-c24c-4aa4-9a69-46463ec047d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:07:50 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb58842b-e7ea-4686-915c-3f558a61b2f1]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:50 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0 Sep 28 16:07:50 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:51 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0" returned: 0 in 1.233s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:51 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 Sep 28 16:07:51 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:52 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06" returned: 0 in 0.893s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:52 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06 Sep 28 16:07:52 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:53 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0.c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06" returned: 0 in 0.736s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-c5e6cd96-e4cd-4a0c-a82b-aaf67117dc06" released by "_delete_snapshot" :: held 3.954s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-82be997e-c24c-4aa4-9a69-46463ec047d0" released by "delete_snapshot" :: held 4.004s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:53 devstack cinder-volume[87087]: WARNING cinder.quota [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1578073730 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1578073730, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:07:53 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] Created reservations ['5262761e-0d5c-4670-be30-8292e74f52df', '957d3708-9d83-4222-9f40-4b1f0c8f0f66', 'f9cce8a1-e349-4b64-8755-182f9d5fc7b0', '0c1fdd0a-65df-47c4-aefb-b9c963392636'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:07:54 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9d41b352-c945-4972-9635-f84e400884b9 tempest-GroupSnapshotsTest-696468924 None] group_snapshot 5f36d870-a170-4ffb-9ee3-a85c6b700a68: deleted successfully Sep 28 16:07:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-16242bfb-dc3f-48c2-978a-4062863c7455 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "cinder-quobyte-82be997e-c24c-4aa4-9a69-46463ec047d0" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-16242bfb-dc3f-48c2-978a-4062863c7455 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-82be997e-c24c-4aa4-9a69-46463ec047d0" acquired by "delete_volume" :: waited 0.042s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:55 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3565b157-8111-46d6-a401-def01630662c]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-16242bfb-dc3f-48c2-978a-4062863c7455 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:55 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0 Sep 28 16:07:55 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:56 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-16242bfb-dc3f-48c2-978a-4062863c7455 tempest-GroupSnapshotsTest-696468924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0" returned: 0 in 1.139s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-16242bfb-dc3f-48c2-978a-4062863c7455 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:56 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0 Sep 28 16:07:56 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:56 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-16242bfb-dc3f-48c2-978a-4062863c7455 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-82be997e-c24c-4aa4-9a69-46463ec047d0" returned: 0 in 0.637s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-16242bfb-dc3f-48c2-978a-4062863c7455 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-82be997e-c24c-4aa4-9a69-46463ec047d0" released by "delete_volume" :: held 1.986s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:57 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-16242bfb-dc3f-48c2-978a-4062863c7455 tempest-GroupSnapshotsTest-696468924 None] Created reservations ['daa0a1f5-5e6a-40b4-bb62-3469bbe39028'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:07:57 devstack cinder-volume[87087]: WARNING cinder.db.api [None req-16242bfb-dc3f-48c2-978a-4062863c7455 tempest-GroupSnapshotsTest-696468924 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1578073730'] Sep 28 16:07:57 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-16242bfb-dc3f-48c2-978a-4062863c7455 tempest-GroupSnapshotsTest-696468924 None] Created reservations ['7ad83735-eb10-4d5b-9764-060726078eac', '06404fb9-0db5-461d-8329-a372554462db', '170af6c0-a61b-4866-bc69-f01388d75097', '5df3d874-fd98-47e3-b11a-a9c7b44c80af'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:07:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-16242bfb-dc3f-48c2-978a-4062863c7455 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-16242bfb-dc3f-48c2-978a-4062863c7455 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-16242bfb-dc3f-48c2-978a-4062863c7455 tempest-GroupSnapshotsTest-696468924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:07:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-16242bfb-dc3f-48c2-978a-4062863c7455 tempest-GroupSnapshotsTest-696468924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:07:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-16242bfb-dc3f-48c2-978a-4062863c7455 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-16242bfb-dc3f-48c2-978a-4062863c7455 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:57 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:07:57 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:58 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-16242bfb-dc3f-48c2-978a-4062863c7455 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.756s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:58 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-16242bfb-dc3f-48c2-978a-4062863c7455 tempest-GroupSnapshotsTest-696468924 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:07:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-16242bfb-dc3f-48c2-978a-4062863c7455 tempest-GroupSnapshotsTest-696468924 None] Delete group completed successfully. Sep 28 16:07:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7b805851-7535-4016-a051-d7bf522fd5ae tempest-GroupSnapshotsTest-696468924 None] Group tempest-GroupSnapshotsTest-Group-297557317: creating Sep 28 16:07:58 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d5f8c18-62cd-45ae-b64a-26406372f780 tempest-VolumesActionsTest-97612136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 /opt/stack/data/cinder/conversion/630768f2-8bd8-47f4-aba2-fb6a9f625536.temp_image.7d6943e1-0f9b-4023-a028-31d091a16c60yb9ocybk.img" returned: 0 in 9.447s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:58 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c03490-e521-454a-bb99-bbd36b86554a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d5f8c18-62cd-45ae-b64a-26406372f780 tempest-VolumesActionsTest-97612136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7b805851-7535-4016-a051-d7bf522fd5ae tempest-GroupSnapshotsTest-696468924 None] Group tempest-GroupSnapshotsTest-Group-297557317: created successfully Sep 28 16:07:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7b805851-7535-4016-a051-d7bf522fd5ae tempest-GroupSnapshotsTest-696468924 None] Create group completed successfully. Sep 28 16:07:58 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 Sep 28 16:07:58 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:59 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d5f8c18-62cd-45ae-b64a-26406372f780 tempest-VolumesActionsTest-97612136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536" returned: 0 in 0.670s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:59 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-0d5f8c18-62cd-45ae-b64a-26406372f780 tempest-VolumesActionsTest-97612136 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536, size 1024.00 MB, duration 9.45 sec, destination /opt/stack/data/cinder/conversion/630768f2-8bd8-47f4-aba2-fb6a9f625536.temp_image.7d6943e1-0f9b-4023-a028-31d091a16c60yb9ocybk.img {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:07:59 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-0d5f8c18-62cd-45ae-b64a-26406372f780 tempest-VolumesActionsTest-97612136 None] Converted 1024.00 MB image at 108.34 MB/s Sep 28 16:07:59 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-0d5f8c18-62cd-45ae-b64a-26406372f780 tempest-VolumesActionsTest-97612136 None] 7d6943e1-0f9b-4023-a028-31d091a16c60 was raw, no need to convert to raw {{(pid=87087) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 16:08:00 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:08:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Flow 'volume_create_manager' (f79caf44-98fb-4101-a542-9fb2faa40660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:08:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfd09eb-0b73-4efd-bf3b-023948167e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfd09eb-0b73-4efd-bf3b-023948167e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814800665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=120b03da-56ca-4f32-8d3b-255a08ebdbe5,host='devstack@QuobyteHD#QuobyteHD',id=c41c9f3c-6d18-4079-81da-6882858dbc84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d92cb2b55a49a7b66431db4a34a3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:08:01Z,use_quota=True,user_id='0180a068d2ce428a870f66da4ddd4f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae80be64-0dd8-4522-8e0a-2bdfa5968b0d),volume_type_id=ae80be64-0dd8-4522-8e0a-2bdfa5968b0d)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8130b0d-ecab-4418-8b0e-bd6d7b166d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8130b0d-ecab-4418-8b0e-bd6d7b166d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4654871-181d-442a-93d5-878b288e8897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4654871-181d-442a-93d5-878b288e8897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c41c9f3c-6d18-4079-81da-6882858dbc84', 'volume_name': 'volume-c41c9f3c-6d18-4079-81da-6882858dbc84', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daaca817-aac2-471c-b138-b80d9cab5844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daaca817-aac2-471c-b138-b80d9cab5844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa554295-e036-4efa-aa31-7eb97c36f6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:01 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Volume c41c9f3c-6d18-4079-81da-6882858dbc84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c41c9f3c-6d18-4079-81da-6882858dbc84', 'volume_size': 1} Sep 28 16:08:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:10 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=42,cinder:SELECT=53,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:08:11 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=52,cinder:UPDATE=44,cinder:INSERT=9 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:08:21 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:08:21 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:08:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0d5f8c18-62cd-45ae-b64a-26406372f780 tempest-VolumesActionsTest-97612136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.891s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0d5f8c18-62cd-45ae-b64a-26406372f780 tempest-VolumesActionsTest-97612136 None] Uploaded volume to glance image-id: 7d6943e1-0f9b-4023-a028-31d091a16c60. {{(pid=87087) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 16:08:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-459672fc-08ed-4f27-8257-fadb382de9a9 tempest-TestImageHashVerification-144809291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 35.110s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:24 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9ea496-b483-4957-81a5-e51e5013fef0]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-459672fc-08ed-4f27-8257-fadb382de9a9 tempest-TestImageHashVerification-144809291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0d5f8c18-62cd-45ae-b64a-26406372f780 tempest-VolumesActionsTest-97612136 None] Copy volume to image completed successfully. Sep 28 16:08:24 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5 Sep 28 16:08:24 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:25 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-459672fc-08ed-4f27-8257-fadb382de9a9 tempest-TestImageHashVerification-144809291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5" returned: 0 in 0.437s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:25 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b747d48c-5b3a-4167-9e5e-27b00fd6edaa]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-459672fc-08ed-4f27-8257-fadb382de9a9 tempest-TestImageHashVerification-144809291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:25 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5 Sep 28 16:08:25 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:25 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-459672fc-08ed-4f27-8257-fadb382de9a9 tempest-TestImageHashVerification-144809291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5" returned: 0 in 0.521s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-459672fc-08ed-4f27-8257-fadb382de9a9 tempest-TestImageHashVerification-144809291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5 /opt/stack/data/cinder/conversion/4b0418f2-c3e5-40c8-850d-95f7ab4579b5.temp_image.c438cb0e-6934-4ee4-bfda-f2105cc413a7pj4tqj6v.img {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:25 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5 /opt/stack/data/cinder/conversion/4b0418f2-c3e5-40c8-850d-95f7ab4579b5.temp_image.c438cb0e-6934-4ee4-bfda-f2105cc413a7pj4tqj6v.img Sep 28 16:08:25 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:27 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:08:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Flow 'volume_create_manager' (7c0ad5a7-15e1-44ea-9957-c7ef94753c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:08:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b96fbe2-7068-449a-994f-1b7b0d80068a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b96fbe2-7068-449a-994f-1b7b0d80068a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-376694471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56e133e-a575-4ebb-8cc9-6967f7f56881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c222d31ec51848279de98269d6837905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:08:27Z,use_quota=True,user_id='08f9986f124e440a84f9020544ba598f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c115ac56-14d8-4bab-8773-2216dae0eda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c115ac56-14d8-4bab-8773-2216dae0eda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff80a17-5ea1-46f1-82ef-c33a358d6fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff80a17-5ea1-46f1-82ef-c33a358d6fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a56e133e-a575-4ebb-8cc9-6967f7f56881', 'volume_name': 'volume-a56e133e-a575-4ebb-8cc9-6967f7f56881', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd73e54e-ed36-4cf8-a0fe-90e97c7d2bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd73e54e-ed36-4cf8-a0fe-90e97c7d2bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf517bdf-3f55-4023-926a-3f4bb17ba070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:27 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Volume a56e133e-a575-4ebb-8cc9-6967f7f56881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a56e133e-a575-4ebb-8cc9-6967f7f56881', 'volume_size': 1} Sep 28 16:08:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:32 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-459672fc-08ed-4f27-8257-fadb382de9a9 tempest-TestImageHashVerification-144809291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5 /opt/stack/data/cinder/conversion/4b0418f2-c3e5-40c8-850d-95f7ab4579b5.temp_image.c438cb0e-6934-4ee4-bfda-f2105cc413a7pj4tqj6v.img" returned: 0 in 6.655s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:32 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea4e4c9-af7b-4a95-877f-040c1c317029]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-459672fc-08ed-4f27-8257-fadb382de9a9 tempest-TestImageHashVerification-144809291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:32 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5 Sep 28 16:08:32 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:33 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-459672fc-08ed-4f27-8257-fadb382de9a9 tempest-TestImageHashVerification-144809291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5" returned: 0 in 0.591s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:33 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-459672fc-08ed-4f27-8257-fadb382de9a9 tempest-TestImageHashVerification-144809291 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/conversion/4b0418f2-c3e5-40c8-850d-95f7ab4579b5.temp_image.c438cb0e-6934-4ee4-bfda-f2105cc413a7pj4tqj6v.img {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:08:33 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-459672fc-08ed-4f27-8257-fadb382de9a9 tempest-TestImageHashVerification-144809291 None] Converted 1024.00 MB image at 153.85 MB/s Sep 28 16:08:33 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-459672fc-08ed-4f27-8257-fadb382de9a9 tempest-TestImageHashVerification-144809291 None] c438cb0e-6934-4ee4-bfda-f2105cc413a7 was raw, no need to convert to raw {{(pid=87087) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 16:08:34 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:08:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:35 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:08:35 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:35 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.341s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:08:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:08:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:08:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:08:43 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:08:43 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=4 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:08:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-459672fc-08ed-4f27-8257-fadb382de9a9 tempest-TestImageHashVerification-144809291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.070s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-459672fc-08ed-4f27-8257-fadb382de9a9 tempest-TestImageHashVerification-144809291 None] Uploaded volume to glance image-id: c438cb0e-6934-4ee4-bfda-f2105cc413a7. {{(pid=87087) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 16:08:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 51.704s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=120b03da-56ca-4f32-8d3b-255a08ebdbe5,created_at=2026-09-28T14:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814800665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=120b03da-56ca-4f32-8d3b-255a08ebdbe5,host='devstack@QuobyteHD#QuobyteHD',id=c41c9f3c-6d18-4079-81da-6882858dbc84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d92cb2b55a49a7b66431db4a34a3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:08:01Z,use_quota=True,user_id='0180a068d2ce428a870f66da4ddd4f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae80be64-0dd8-4522-8e0a-2bdfa5968b0d),volume_type_id=ae80be64-0dd8-4522-8e0a-2bdfa5968b0d)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:08:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Creating volume c41c9f3c-6d18-4079-81da-6882858dbc84 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:08:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:08:52 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:08:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:52 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-459672fc-08ed-4f27-8257-fadb382de9a9 tempest-TestImageHashVerification-144809291 None] Copy volume to image completed successfully. Sep 28 16:08:52 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84 1073741824 Sep 28 16:08:52 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:53 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84 1073741824" returned: 0 in 0.541s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:53 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84 Sep 28 16:08:53 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:53 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84" returned: 0 in 0.322s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:08:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 26.400s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa554295-e036-4efa-aa31-7eb97c36f6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c41c9f3c-6d18-4079-81da-6882858dbc84', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705552de-fde3-4bd0-8477-cdca52d46f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:53 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d791a0f-d5e3-4d56-9885-0c1206f700ba]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:53 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Volume volume-c41c9f3c-6d18-4079-81da-6882858dbc84 (c41c9f3c-6d18-4079-81da-6882858dbc84): created successfully Sep 28 16:08:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705552de-fde3-4bd0-8477-cdca52d46f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Flow 'volume_create_manager' (f79caf44-98fb-4101-a542-9fb2faa40660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:08:53 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b0fc6b7a-2d03-438e-88a6-03784c9265af tempest-GroupSnapshotsTest-696468924 None] Created volume successfully. Sep 28 16:08:53 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 Sep 28 16:08:53 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:54 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536" returned: 0 in 0.546s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:54 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[014d68ee-7aa1-462c-9580-2e8fe0ff1e7e]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:54 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 Sep 28 16:08:54 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] Acquiring lock "cinder-4b0418f2-c3e5-40c8-850d-95f7ab4579b5-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] Lock "cinder-4b0418f2-c3e5-40c8-850d-95f7ab4579b5-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] Acquiring lock "cinder-quobyte-4b0418f2-c3e5-40c8-850d-95f7ab4579b5" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] Lock "cinder-quobyte-4b0418f2-c3e5-40c8-850d-95f7ab4579b5" acquired by "delete_volume" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:54 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[568aa9f7-b7fd-4a97-b688-d8a8a26b692c]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:55 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:55 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:08:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Flow 'volume_create_manager' (caac6091-248b-47f9-a5fe-ecb27f64aba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:08:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e317d3b-a76c-4fc4-bb59-b33ab5832d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536" returned: 0 in 0.667s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 /opt/stack/data/cinder/conversion/630768f2-8bd8-47f4-aba2-fb6a9f625536.temp_image.ab7af7f7-abb6-44ce-ae42-3b0916944874ea8kujwc.img {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e317d3b-a76c-4fc4-bb59-b33ab5832d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1880776675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=120b03da-56ca-4f32-8d3b-255a08ebdbe5,host='devstack@QuobyteHD#QuobyteHD',id=e0e9479b-949c-4284-ae05-bafad6e3220d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d92cb2b55a49a7b66431db4a34a3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:08:55Z,use_quota=True,user_id='0180a068d2ce428a870f66da4ddd4f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae80be64-0dd8-4522-8e0a-2bdfa5968b0d),volume_type_id=ae80be64-0dd8-4522-8e0a-2bdfa5968b0d)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1390bae1-e547-46a3-bd15-af90c103335b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:55 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5 Sep 28 16:08:55 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1390bae1-e547-46a3-bd15-af90c103335b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:55 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 /opt/stack/data/cinder/conversion/630768f2-8bd8-47f4-aba2-fb6a9f625536.temp_image.ab7af7f7-abb6-44ce-ae42-3b0916944874ea8kujwc.img Sep 28 16:08:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6bb93f9-14b2-48ce-a32e-402d1012f534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:55 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6bb93f9-14b2-48ce-a32e-402d1012f534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0e9479b-949c-4284-ae05-bafad6e3220d', 'volume_name': 'volume-e0e9479b-949c-4284-ae05-bafad6e3220d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40fe0d7e-51fe-4c36-8bf8-132ea26dd033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40fe0d7e-51fe-4c36-8bf8-132ea26dd033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19fa59a-eb18-4398-9e9f-bed7658b8c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:55 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Volume e0e9479b-949c-4284-ae05-bafad6e3220d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0e9479b-949c-4284-ae05-bafad6e3220d', 'volume_size': 1} Sep 28 16:08:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:55 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5" returned: 0 in 0.545s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:55 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5 Sep 28 16:08:55 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:56 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4b0418f2-c3e5-40c8-850d-95f7ab4579b5" returned: 0 in 0.704s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] Lock "cinder-quobyte-4b0418f2-c3e5-40c8-850d-95f7ab4579b5" released by "delete_volume" :: held 1.342s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:56 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] Created reservations ['d72ab2df-d6b7-4387-8923-615354d30b93', '93d8163a-5cff-466b-8d1b-4e73c103e7a9', '45ffbe90-377e-440b-a071-c665f2c1fc3b', 'eeb90b7c-133c-413a-9b13-6e485f8ee9c4'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:08:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:56 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:08:56 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:56 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.397s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:56 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:08:56 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] Deleted volume successfully. Sep 28 16:08:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-118caaf7-df70-4dd2-a140-105e96308187 tempest-TestImageHashVerification-144809291 None] Lock "cinder-4b0418f2-c3e5-40c8-850d-95f7ab4579b5-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:02 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 /opt/stack/data/cinder/conversion/630768f2-8bd8-47f4-aba2-fb6a9f625536.temp_image.ab7af7f7-abb6-44ce-ae42-3b0916944874ea8kujwc.img" returned: 0 in 7.659s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:02 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f24e5c2-cbf3-431e-bbf1-e7e811e36bd5]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:02 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 Sep 28 16:09:02 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:03 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536" returned: 0 in 0.645s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:03 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536, size 1024.00 MB, duration 7.66 sec, destination /opt/stack/data/cinder/conversion/630768f2-8bd8-47f4-aba2-fb6a9f625536.temp_image.ab7af7f7-abb6-44ce-ae42-3b0916944874ea8kujwc.img {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:09:03 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] Converted 1024.00 MB image at 133.68 MB/s Sep 28 16:09:03 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] ab7af7f7-abb6-44ce-ae42-3b0916944874 was raw, converting to qcow2 {{(pid=87087) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 16:09:03 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[db65edea-36ce-468e-851e-5881e8ff5735]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/630768f2-8bd8-47f4-aba2-fb6a9f625536.temp_image.ab7af7f7-abb6-44ce-ae42-3b0916944874ea8kujwc.img {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:03 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/630768f2-8bd8-47f4-aba2-fb6a9f625536.temp_image.ab7af7f7-abb6-44ce-ae42-3b0916944874ea8kujwc.img Sep 28 16:09:03 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:03 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/630768f2-8bd8-47f4-aba2-fb6a9f625536.temp_image.ab7af7f7-abb6-44ce-ae42-3b0916944874ea8kujwc.img" returned: 0 in 0.494s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/630768f2-8bd8-47f4-aba2-fb6a9f625536.temp_image.ab7af7f7-abb6-44ce-ae42-3b0916944874ea8kujwc.img {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:04 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/630768f2-8bd8-47f4-aba2-fb6a9f625536.temp_image.ab7af7f7-abb6-44ce-ae42-3b0916944874ea8kujwc.img Sep 28 16:09:04 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:04 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/630768f2-8bd8-47f4-aba2-fb6a9f625536.temp_image.ab7af7f7-abb6-44ce-ae42-3b0916944874ea8kujwc.img" returned: 1 in 0.416s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/630768f2-8bd8-47f4-aba2-fb6a9f625536.temp_image.ab7af7f7-abb6-44ce-ae42-3b0916944874ea8kujwc.img' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:09:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/630768f2-8bd8-47f4-aba2-fb6a9f625536.temp_image.ab7af7f7-abb6-44ce-ae42-3b0916944874ea8kujwc.img /opt/stack/data/cinder/conversion/vol_upload_7qasmdep {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:04 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/630768f2-8bd8-47f4-aba2-fb6a9f625536.temp_image.ab7af7f7-abb6-44ce-ae42-3b0916944874ea8kujwc.img /opt/stack/data/cinder/conversion/vol_upload_7qasmdep Sep 28 16:09:04 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:04 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/630768f2-8bd8-47f4-aba2-fb6a9f625536.temp_image.ab7af7f7-abb6-44ce-ae42-3b0916944874ea8kujwc.img /opt/stack/data/cinder/conversion/vol_upload_7qasmdep" returned: 0 in 0.350s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:04 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] Image conversion details: src /opt/stack/data/cinder/conversion/630768f2-8bd8-47f4-aba2-fb6a9f625536.temp_image.ab7af7f7-abb6-44ce-ae42-3b0916944874ea8kujwc.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_7qasmdep {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:09:04 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 16:09:04 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3f01ab-3e34-47d5-bc7c-e7bff3961f78]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7qasmdep {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:04 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7qasmdep Sep 28 16:09:04 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:05 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7qasmdep" returned: 0 in 0.416s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:06 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:INSERT=2,cinder:UPDATE=13,cinder:SELECT=6,cinder:DELETE=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:09:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.324s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] Uploaded volume to glance image-id: ab7af7f7-abb6-44ce-ae42-3b0916944874. {{(pid=87087) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 16:09:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 39.434s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-376694471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56e133e-a575-4ebb-8cc9-6967f7f56881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c222d31ec51848279de98269d6837905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:08:27Z,use_quota=True,user_id='08f9986f124e440a84f9020544ba598f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Creating volume a56e133e-a575-4ebb-8cc9-6967f7f56881 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:07 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:09:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a56e133e-a575-4ebb-8cc9-6967f7f56881 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:07 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a56e133e-a575-4ebb-8cc9-6967f7f56881 1073741824 Sep 28 16:09:07 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-519cfa38-f039-4b8c-99a6-1482299ac94c tempest-VolumesActionsTest-97612136 None] Copy volume to image completed successfully. Sep 28 16:09:07 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a56e133e-a575-4ebb-8cc9-6967f7f56881 1073741824" returned: 0 in 0.599s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a56e133e-a575-4ebb-8cc9-6967f7f56881 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:07 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a56e133e-a575-4ebb-8cc9-6967f7f56881 Sep 28 16:09:07 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] Acquiring lock "cinder-630768f2-8bd8-47f4-aba2-fb6a9f625536-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] Lock "cinder-630768f2-8bd8-47f4-aba2-fb6a9f625536-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] Acquiring lock "cinder-quobyte-630768f2-8bd8-47f4-aba2-fb6a9f625536" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] Lock "cinder-quobyte-630768f2-8bd8-47f4-aba2-fb6a9f625536" acquired by "delete_volume" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d17f58e-5c1d-40bf-9606-9e1c234a0a5a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:08 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a56e133e-a575-4ebb-8cc9-6967f7f56881" returned: 0 in 0.471s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.134s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=120b03da-56ca-4f32-8d3b-255a08ebdbe5,created_at=2026-09-28T14:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1880776675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=120b03da-56ca-4f32-8d3b-255a08ebdbe5,host='devstack@QuobyteHD#QuobyteHD',id=e0e9479b-949c-4284-ae05-bafad6e3220d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d92cb2b55a49a7b66431db4a34a3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:08:55Z,use_quota=True,user_id='0180a068d2ce428a870f66da4ddd4f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae80be64-0dd8-4522-8e0a-2bdfa5968b0d),volume_type_id=ae80be64-0dd8-4522-8e0a-2bdfa5968b0d)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Creating volume e0e9479b-949c-4284-ae05-bafad6e3220d {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:08 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf517bdf-3f55-4023-926a-3f4bb17ba070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a56e133e-a575-4ebb-8cc9-6967f7f56881', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:08 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 Sep 28 16:09:08 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e66ec15-9882-47e0-9a04-7ae05004c038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:08 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d 1073741824 Sep 28 16:09:08 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:08 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Volume volume-a56e133e-a575-4ebb-8cc9-6967f7f56881 (a56e133e-a575-4ebb-8cc9-6967f7f56881): created successfully Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e66ec15-9882-47e0-9a04-7ae05004c038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Flow 'volume_create_manager' (7c0ad5a7-15e1-44ea-9957-c7ef94753c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:08 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8b7caa7b-5e45-460c-9277-32f2387c7b4b tempest-AttachVolumeNegativeTest-429818067 None] Created volume successfully. Sep 28 16:09:08 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536" returned: 0 in 0.533s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:08 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536 Sep 28 16:09:08 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:08 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d 1073741824" returned: 0 in 0.632s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:08 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-630768f2-8bd8-47f4-aba2-fb6a9f625536" returned: 0 in 0.324s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:09 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d Sep 28 16:09:09 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] Lock "cinder-quobyte-630768f2-8bd8-47f4-aba2-fb6a9f625536" released by "delete_volume" :: held 0.942s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:09 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] Created reservations ['62498015-2942-4d34-b18e-0a08496e41cb', 'a99c806f-7d1c-42dc-96fe-f471d623b0b7', '2be8640c-3602-49d3-81ca-74ad4b36fd2b', 'f6df0e2a-7d18-48c0-ac12-15ef280e7594'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:09 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:09:09 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:09 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d" returned: 0 in 0.550s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19fa59a-eb18-4398-9e9f-bed7658b8c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0e9479b-949c-4284-ae05-bafad6e3220d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5432c2ce-5fe0-4bec-822e-552739e53b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:09 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Volume volume-e0e9479b-949c-4284-ae05-bafad6e3220d (e0e9479b-949c-4284-ae05-bafad6e3220d): created successfully Sep 28 16:09:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5432c2ce-5fe0-4bec-822e-552739e53b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Flow 'volume_create_manager' (caac6091-248b-47f9-a5fe-ecb27f64aba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:09 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-85d16362-5aad-4524-86e1-e3a763feb759 tempest-GroupSnapshotsTest-696468924 None] Created volume successfully. Sep 28 16:09:09 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.653s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:09 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:09 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] Deleted volume successfully. Sep 28 16:09:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7acd61de-7aea-4485-8ddd-6a5b46acfe6b tempest-VolumesActionsTest-97612136 None] Lock "cinder-630768f2-8bd8-47f4-aba2-fb6a9f625536-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-2028c061-a5fe-4296-b31a-cc2f434dfa6b req-93f06ece-7c68-4cea-a2e7-d3ac4ca46465 tempest-AttachVolumeNegativeTest-429818067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-2028c061-a5fe-4296-b31a-cc2f434dfa6b req-93f06ece-7c68-4cea-a2e7-d3ac4ca46465 tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-2028c061-a5fe-4296-b31a-cc2f434dfa6b req-93f06ece-7c68-4cea-a2e7-d3ac4ca46465 tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-59f02a09-0462-4630-9851-4b1c9bc525a1 tempest-GroupSnapshotsTest-696468924 None] Update group completed successfully. Sep 28 16:09:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-2028c061-a5fe-4296-b31a-cc2f434dfa6b req-93f06ece-7c68-4cea-a2e7-d3ac4ca46465 tempest-AttachVolumeNegativeTest-429818067 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-a56e133e-a575-4ebb-8cc9-6967f7f56881', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e2cb2dc-aeba-4377-bcae-1424eb30b59f', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:09:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-2028c061-a5fe-4296-b31a-cc2f434dfa6b req-93f06ece-7c68-4cea-a2e7-d3ac4ca46465 tempest-AttachVolumeNegativeTest-429818067 None] attachment_update completed successfully. Sep 28 16:09:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-04bec0cc-d23e-4d6c-835d-2e80088c0edf tempest-GroupSnapshotsTest-696468924 None] Update group completed successfully. Sep 28 16:09:13 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b2f0fb3f-2211-432e-9cf3-ca37fc89a5e8 tempest-GroupSnapshotsTest-696468924 None] Update group completed successfully. Sep 28 16:09:15 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d8bf6a5d-5ac8-4ae8-83e8-ad5992d956ed tempest-GroupSnapshotsTest-696468924 None] Update group completed successfully. Sep 28 16:09:15 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-004e93fd-1b10-49f8-83db-45126f54977e req-0aa46a65-a0be-4215-b668-27b9a748916c tempest-AttachVolumeNegativeTest-429818067 None] Terminate volume connection completed successfully. Sep 28 16:09:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-004e93fd-1b10-49f8-83db-45126f54977e req-0aa46a65-a0be-4215-b668-27b9a748916c tempest-AttachVolumeNegativeTest-429818067 None] Deleting attachment 7e2cb2dc-aeba-4377-bcae-1424eb30b59f. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Flow 'volume_create_manager' (c803a38d-1cc0-4387-b42a-bd5b5d524745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0089ec79-75c9-4855-bff6-2398e6a55588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0089ec79-75c9-4855-bff6-2398e6a55588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-566523340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a81b5d2ec941b389dae6c5e4ce197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:16Z,use_quota=True,user_id='c71f1533fcf34ffaa71def384a666710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418821e7-06bf-4999-b521-cd7ddc0f44cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418821e7-06bf-4999-b521-cd7ddc0f44cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ed395e-2831-44c0-a2a5-906d0cb9225b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ed395e-2831-44c0-a2a5-906d0cb9225b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5', 'volume_name': 'volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5783720-292e-40e6-a6b4-706aa8819d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5783720-292e-40e6-a6b4-706aa8819d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f7f093-ed85-4e2f-8098-a568d43d2aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:16 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Volume eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5', 'volume_size': 1} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-566523340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a81b5d2ec941b389dae6c5e4ce197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:16Z,use_quota=True,user_id='c71f1533fcf34ffaa71def384a666710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Creating volume eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:16 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:09:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:16 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 1073741824 Sep 28 16:09:16 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:17 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] GroupSnapshot ea661dd8-17e3-4a82-be5b-66e5050fa998: creating. Sep 28 16:09:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Group snapshot ea661dd8-17e3-4a82-be5b-66e5050fa998: creating. {{(pid=87087) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 16:09:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:17 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 1073741824" returned: 0 in 0.963s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:17 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 Sep 28 16:09:17 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:18 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5" returned: 0 in 0.360s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.816s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f7f093-ed85-4e2f-8098-a568d43d2aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a6e519-0226-4cc9-ba0d-4d83dd4780d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Creating offline snapshot 6edfe750-aaa0-42a9-a127-330711854352 of volume e0e9479b-949c-4284-ae05-bafad6e3220d {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:09:18 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Volume volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 (eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5): created successfully Sep 28 16:09:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a6e519-0226-4cc9-ba0d-4d83dd4780d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Flow 'volume_create_manager' (c803a38d-1cc0-4387-b42a-bd5b5d524745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:18 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4ee377-6928-4ac5-ba1b-cc808cc5e6e2]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:18 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e3bb0ed1-7843-4db1-85bb-f0fe329cb6ed tempest-CreateVolumesFromSnapshotTest-1775197516 None] Created volume successfully. Sep 28 16:09:18 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d Sep 28 16:09:18 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-77ec6f9a-625b-444e-8792-82dc9f21b803 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:19 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d" returned: 0 in 0.870s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:19 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352 1G Sep 28 16:09:19 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:19 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352 1G" returned: 0 in 0.550s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0e9479b-949c-4284-ae05-bafad6e3220d -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:19 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0e9479b-949c-4284-ae05-bafad6e3220d -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352 Sep 28 16:09:19 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:20 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0e9479b-949c-4284-ae05-bafad6e3220d -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352" returned: 0 in 0.404s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:20 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:09:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:20 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352 Sep 28 16:09:20 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:20 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352" returned: 0 in 0.362s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:20 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.info Sep 28 16:09:20 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:20 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.info" returned: 0 in 0.352s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:20 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:09:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:21 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.info Sep 28 16:09:21 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:21 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.info" returned: 0 in 0.358s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.094s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Creating offline snapshot 8152f89a-68ee-465e-948f-b790f660fbfc of volume c41c9f3c-6d18-4079-81da-6882858dbc84 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:09:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f74f8f-e9dd-469f-99d3-a4cd508bd108]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:21 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84 Sep 28 16:09:21 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:22 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84" returned: 0 in 0.648s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:22 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc 1G Sep 28 16:09:22 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:22 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc 1G" returned: 0 in 0.558s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c41c9f3c-6d18-4079-81da-6882858dbc84 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:22 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:22 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c41c9f3c-6d18-4079-81da-6882858dbc84 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc Sep 28 16:09:22 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Flow 'volume_create_manager' (bca91070-e019-4316-aea5-552879332f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4487e582-22f3-4444-bcf9-ea794e8cd75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4487e582-22f3-4444-bcf9-ea794e8cd75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-783351749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09976293-e74d-4058-bc1a-2b3baf50db48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2036854d584352a5f85f77007e9575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:23Z,use_quota=True,user_id='0de89530e0fc493097a1bf576ebfbd14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c12207-99c5-46c9-936c-085d42c0f834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c12207-99c5-46c9-936c-085d42c0f834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ac92ee-dd91-446b-a4d1-eca5ab594138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:22 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:09:23 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c41c9f3c-6d18-4079-81da-6882858dbc84 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc" returned: 0 in 0.408s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:23 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:09:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:23 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc Sep 28 16:09:23 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ac92ee-dd91-446b-a4d1-eca5ab594138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '09976293-e74d-4058-bc1a-2b3baf50db48', 'volume_name': 'volume-09976293-e74d-4058-bc1a-2b3baf50db48', 'volume_size': 1, 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3682e9714c0d4e0582fb2ca18f45f417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'created_at': datetime.datetime(2026, 9, 28, 13, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7abc4afd-c71a-462f-b806-ba7da0f478cc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94cf5f0e-fbbb-4710-9b1b-0ef897c9bb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94cf5f0e-fbbb-4710-9b1b-0ef897c9bb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f606f055-9fbf-4f05-8ece-ae3f345bc123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:23 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Volume 09976293-e74d-4058-bc1a-2b3baf50db48: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-09976293-e74d-4058-bc1a-2b3baf50db48', 'volume_size': 1, 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3682e9714c0d4e0582fb2ca18f45f417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'created_at': datetime.datetime(2026, 9, 28, 13, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7abc4afd-c71a-462f-b806-ba7da0f478cc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 16:09:23 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Trying to clone 09976293-e74d-4058-bc1a-2b3baf50db48 from image 7abc4afd-c71a-462f-b806-ba7da0f478cc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:09:23 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc" returned: 0 in 0.398s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:23 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.info Sep 28 16:09:23 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:23 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_4scg26j2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:09:23 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Image download 20.69 MB at 20.69 MB/s Sep 28 16:09:23 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7371c759-5f08-469b-9ba6-7d84898eb2d8]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_4scg26j2devstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:23 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_4scg26j2devstack@QuobyteHD Sep 28 16:09:23 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:23 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.info" returned: 0 in 0.456s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:23 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:09:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:24 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.info Sep 28 16:09:24 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:24 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_4scg26j2devstack@QuobyteHD" returned: 0 in 0.414s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:24 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Temporary image 7abc4afd-c71a-462f-b806-ba7da0f478cc is fetched for user 0de89530e0fc493097a1bf576ebfbd14. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:09:24 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.info" returned: 0 in 0.353s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.980s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:24 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec638c07-96bd-49af-8c82-f3624dbe2053]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-77ec6f9a-625b-444e-8792-82dc9f21b803 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.188s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_4scg26j2devstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-77ec6f9a-625b-444e-8792-82dc9f21b803 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Creating offline snapshot b3c7c15f-8ad7-4a75-b408-8e9efd617d31 of volume eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:09:24 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[558f58bd-0745-460a-8b16-77eebe4db1ac]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77ec6f9a-625b-444e-8792-82dc9f21b803 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:24 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_4scg26j2devstack@QuobyteHD Sep 28 16:09:24 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-cf50c531-6787-41c7-9225-dac848b8c4b4 tempest-GroupSnapshotsTest-696468924 None] group_snapshot ea661dd8-17e3-4a82-be5b-66e5050fa998: created successfully Sep 28 16:09:24 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 Sep 28 16:09:24 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:24 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_4scg26j2devstack@QuobyteHD" returned: 0 in 0.595s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:25 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77ec6f9a-625b-444e-8792-82dc9f21b803 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5" returned: 0 in 0.601s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77ec6f9a-625b-444e-8792-82dc9f21b803 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:25 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31 1G Sep 28 16:09:25 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:25 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] group_snapshot ea661dd8-17e3-4a82-be5b-66e5050fa998: deleting Sep 28 16:09:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] group_snapshot ea661dd8-17e3-4a82-be5b-66e5050fa998: deleting {{(pid=87087) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 16:09:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "cinder-quobyte-e0e9479b-949c-4284-ae05-bafad6e3220d" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-e0e9479b-949c-4284-ae05-bafad6e3220d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "cinder-quobyte-6edfe750-aaa0-42a9-a127-330711854352" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-6edfe750-aaa0-42a9-a127-330711854352" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Deleting offline snapshot 6edfe750-aaa0-42a9-a127-330711854352 of volume e0e9479b-949c-4284-ae05-bafad6e3220d {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:09:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] snapshot_file for this snap is: volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:09:25 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[127b0d19-2ea8-41ed-b2df-ef046be1bf5e]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:25 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352 Sep 28 16:09:25 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:25 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77ec6f9a-625b-444e-8792-82dc9f21b803 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31 1G" returned: 0 in 0.625s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77ec6f9a-625b-444e-8792-82dc9f21b803 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:25 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31 Sep 28 16:09:25 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:25 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352" returned: 0 in 0.610s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0e9479b-949c-4284-ae05-bafad6e3220d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:09:26 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[260fc00e-eaf1-41aa-a475-329ce19c8879]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:26 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77ec6f9a-625b-444e-8792-82dc9f21b803 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31" returned: 0 in 0.444s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:26 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-77ec6f9a-625b-444e-8792-82dc9f21b803 tempest-CreateVolumesFromSnapshotTest-1775197516 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31 is being set with open permissions: ugo+rw Sep 28 16:09:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77ec6f9a-625b-444e-8792-82dc9f21b803 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:26 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31 Sep 28 16:09:26 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:26 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d Sep 28 16:09:26 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:26 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77ec6f9a-625b-444e-8792-82dc9f21b803 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31" returned: 0 in 0.294s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77ec6f9a-625b-444e-8792-82dc9f21b803 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:26 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d" returned: 0 in 0.433s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:26 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.info Sep 28 16:09:26 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:26 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352 Sep 28 16:09:26 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:26 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77ec6f9a-625b-444e-8792-82dc9f21b803 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.info" returned: 0 in 0.343s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:26 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-77ec6f9a-625b-444e-8792-82dc9f21b803 tempest-CreateVolumesFromSnapshotTest-1775197516 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.info is being set with open permissions: ugo+rw Sep 28 16:09:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77ec6f9a-625b-444e-8792-82dc9f21b803 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:26 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.info Sep 28 16:09:26 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:26 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352" returned: 0 in 0.516s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:27 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352 Sep 28 16:09:27 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:27 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77ec6f9a-625b-444e-8792-82dc9f21b803 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.info" returned: 0 in 0.353s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-77ec6f9a-625b-444e-8792-82dc9f21b803 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.808s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.212s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-783351749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09976293-e74d-4058-bc1a-2b3baf50db48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2036854d584352a5f85f77007e9575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:23Z,use_quota=True,user_id='0de89530e0fc493097a1bf576ebfbd14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Creating volume 09976293-e74d-4058-bc1a-2b3baf50db48 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:27 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:27 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48 1073741824 Sep 28 16:09:27 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-77ec6f9a-625b-444e-8792-82dc9f21b803 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Create snapshot completed successfully Sep 28 16:09:27 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d.6edfe750-aaa0-42a9-a127-330711854352" returned: 0 in 0.345s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-6edfe750-aaa0-42a9-a127-330711854352" released by "_delete_snapshot" :: held 2.054s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-e0e9479b-949c-4284-ae05-bafad6e3220d" released by "delete_snapshot" :: held 2.102s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "cinder-quobyte-c41c9f3c-6d18-4079-81da-6882858dbc84" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-c41c9f3c-6d18-4079-81da-6882858dbc84" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "cinder-quobyte-8152f89a-68ee-465e-948f-b790f660fbfc" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-8152f89a-68ee-465e-948f-b790f660fbfc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Deleting offline snapshot 8152f89a-68ee-465e-948f-b790f660fbfc of volume c41c9f3c-6d18-4079-81da-6882858dbc84 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] snapshot_file for this snap is: volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[32971f9d-ed59-4099-8f4c-5339554e4402]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:27 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc Sep 28 16:09:27 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:27 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48 1073741824" returned: 0 in 0.728s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:28 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48 Sep 28 16:09:28 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:28 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc" returned: 0 in 0.677s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c41c9f3c-6d18-4079-81da-6882858dbc84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e64542-c284-4717-87f7-695d43dae1a5]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:28 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84 Sep 28 16:09:28 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:28 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Flow 'volume_create_manager' (a6946336-8974-476b-bbfc-648ac07f1a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366716aa-db1d-4cbb-95ea-ca5623efdf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48" returned: 0 in 0.520s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366716aa-db1d-4cbb-95ea-ca5623efdf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1340721468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a22d79-40e8-4df7-b9e9-aedef1cb23dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a81b5d2ec941b389dae6c5e4ce197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:28Z,use_quota=True,user_id='c71f1533fcf34ffaa71def384a666710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5034852e-4482-4c8c-8d59-10434dde7d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5034852e-4482-4c8c-8d59-10434dde7d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fb013f-4d61-493b-8b23-ba177765b5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fb013f-4d61-493b-8b23-ba177765b5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4a22d79-40e8-4df7-b9e9-aedef1cb23dc', 'volume_name': 'volume-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e1aa3c5-824f-43f3-b1cd-83ec90d6b685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e1aa3c5-824f-43f3-b1cd-83ec90d6b685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7be438e-7019-49e9-81a2-308a217226db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:28 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Volume a4a22d79-40e8-4df7-b9e9-aedef1cb23dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc', 'volume_size': 1} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1340721468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a22d79-40e8-4df7-b9e9-aedef1cb23dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a81b5d2ec941b389dae6c5e4ce197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:28Z,use_quota=True,user_id='c71f1533fcf34ffaa71def384a666710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Creating volume a4a22d79-40e8-4df7-b9e9-aedef1cb23dc {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:28 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Attempting download of 7abc4afd-c71a-462f-b806-ba7da0f478cc ((None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}])) to volume 09976293-e74d-4058-bc1a-2b3baf50db48. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:09:28 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc 1073741824 Sep 28 16:09:28 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c1e2fc-4942-4655-b41d-f498d344a840]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_ncrb7s42 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:29 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84" returned: 0 in 0.803s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:29 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc Sep 28 16:09:29 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:29 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_ncrb7s42 Sep 28 16:09:29 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:29 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc 1073741824" returned: 0 in 0.837s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:29 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc" returned: 0 in 0.610s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:29 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:29 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc Sep 28 16:09:29 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_ncrb7s42" returned: 0 in 0.878s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_ncrb7s42 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:29 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc Sep 28 16:09:29 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:29 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Flow 'volume_create_manager' (6014e79c-d800-44f2-8f74-535951f7b9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f195ee-5564-48c4-be97-6d6774f2df94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f195ee-5564-48c4-be97-6d6774f2df94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-529206379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb34ebda-5a19-4bc7-a4e6-738d832feaaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a81b5d2ec941b389dae6c5e4ce197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:30Z,use_quota=True,user_id='c71f1533fcf34ffaa71def384a666710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:30 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_ncrb7s42 Sep 28 16:09:30 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8eff362-f0b8-4124-8999-144e53701680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8eff362-f0b8-4124-8999-144e53701680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757d490b-0939-41dc-b872-cd8453eb0b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757d490b-0939-41dc-b872-cd8453eb0b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb34ebda-5a19-4bc7-a4e6-738d832feaaa', 'volume_name': 'volume-eb34ebda-5a19-4bc7-a4e6-738d832feaaa', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca9731e-771b-4240-a2e5-a6e0cc2dae1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca9731e-771b-4240-a2e5-a6e0cc2dae1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:30 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30005407-4276-429a-9197-e3ad3d8c6758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:30 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Volume eb34ebda-5a19-4bc7-a4e6-738d832feaaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb34ebda-5a19-4bc7-a4e6-738d832feaaa', 'volume_size': 1} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84.8152f89a-68ee-465e-948f-b790f660fbfc" returned: 0 in 0.478s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-8152f89a-68ee-465e-948f-b790f660fbfc" released by "_delete_snapshot" :: held 2.816s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-c41c9f3c-6d18-4079-81da-6882858dbc84" released by "delete_snapshot" :: held 2.872s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:30 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc" returned: 0 in 0.612s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.185s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-529206379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb34ebda-5a19-4bc7-a4e6-738d832feaaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a81b5d2ec941b389dae6c5e4ce197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:30Z,use_quota=True,user_id='c71f1533fcf34ffaa71def384a666710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Creating volume eb34ebda-5a19-4bc7-a4e6-738d832feaaa {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:30 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb34ebda-5a19-4bc7-a4e6-738d832feaaa 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7be438e-7019-49e9-81a2-308a217226db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:30 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb34ebda-5a19-4bc7-a4e6-738d832feaaa 1073741824 Sep 28 16:09:30 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5771a47-4e3c-4e4f-bca8-cb5eecfdea6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:30 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Volume volume-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc (a4a22d79-40e8-4df7-b9e9-aedef1cb23dc): created successfully Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5771a47-4e3c-4e4f-bca8-cb5eecfdea6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Flow 'volume_create_manager' (a6946336-8974-476b-bbfc-648ac07f1a47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:30 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ab0ed8da-61a6-4d07-9b55-d66e29930bee tempest-CreateVolumesFromSnapshotTest-1775197516 None] Created volume successfully. Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_ncrb7s42" returned: 1 in 0.989s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_ncrb7s42' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53b89ec-db5b-4f28-b41f-639916b55d76]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_4scg26j2devstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Flow 'volume_create_manager' (b4204269-921c-46d4-9af2-062e960ed84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b78e17-f814-453c-924b-677fd0a8ce70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:30 devstack cinder-volume[87087]: WARNING cinder.quota [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-144894875 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-144894875, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:09:30 devstack cinder-volume[87087]: WARNING cinder.quota [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-144894875 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-144894875, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b78e17-f814-453c-924b-677fd0a8ce70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-155556840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a7db8f-99b4-451d-b29d-910f591ef10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a81b5d2ec941b389dae6c5e4ce197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:31Z,use_quota=True,user_id='c71f1533fcf34ffaa71def384a666710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d2dc04-c1db-49d2-8ac1-fbdcfb026156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d2dc04-c1db-49d2-8ac1-fbdcfb026156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebde6d39-041f-4bf4-8a13-a7405cb7e2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebde6d39-041f-4bf4-8a13-a7405cb7e2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60a7db8f-99b4-451d-b29d-910f591ef10a', 'volume_name': 'volume-60a7db8f-99b4-451d-b29d-910f591ef10a', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8768bc2d-90d4-4182-864c-522010b57218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8768bc2d-90d4-4182-864c-522010b57218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5aebd4-5f30-45ce-8b19-d05f9850a8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:30 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_4scg26j2devstack@QuobyteHD Sep 28 16:09:30 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Volume 60a7db8f-99b4-451d-b29d-910f591ef10a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60a7db8f-99b4-451d-b29d-910f591ef10a', 'volume_size': 1} Sep 28 16:09:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:30 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Created reservations ['eec1fd22-a87a-4201-b51b-0cdd8ec5ad20', '188dc86b-660d-41f6-8afd-a31f16b66a54', 'ed4d87b4-357a-4156-ab92-bc4a29b2c53a', '2a1037d7-c1f7-4401-855d-1f61ee8b3c52'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Flow 'volume_create_manager' (66eef9b9-79d0-4dbe-a1b1-146f95624ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1e0ee6-41c3-41af-a06c-17cecac0eedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1e0ee6-41c3-41af-a06c-17cecac0eedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-366671497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2eaaed6-1950-42be-8137-57b74b8f3b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a81b5d2ec941b389dae6c5e4ce197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:31Z,use_quota=True,user_id='c71f1533fcf34ffaa71def384a666710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b70c1d-2678-459a-8805-082920096f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b70c1d-2678-459a-8805-082920096f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42ccfe7-5988-4d4c-a4ed-7eb35ec26be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42ccfe7-5988-4d4c-a4ed-7eb35ec26be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2eaaed6-1950-42be-8137-57b74b8f3b31', 'volume_name': 'volume-d2eaaed6-1950-42be-8137-57b74b8f3b31', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9612b73-ac95-473b-a751-4c2d716672b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9612b73-ac95-473b-a751-4c2d716672b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:31 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2bc5cb-4fc2-4574-8fff-9333706ffd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:31 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Volume d2eaaed6-1950-42be-8137-57b74b8f3b31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2eaaed6-1950-42be-8137-57b74b8f3b31', 'volume_size': 1} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_4scg26j2devstack@QuobyteHD" returned: 0 in 0.553s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] 7abc4afd-c71a-462f-b806-ba7da0f478cc was qcow2, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:09:31 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_4scg26j2devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb34ebda-5a19-4bc7-a4e6-738d832feaaa 1073741824" returned: 0 in 0.968s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:31 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_4scg26j2devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48 Sep 28 16:09:31 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb34ebda-5a19-4bc7-a4e6-738d832feaaa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:31 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb34ebda-5a19-4bc7-a4e6-738d832feaaa Sep 28 16:09:31 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] Created reservations ['b3c9253d-0004-40da-8ab9-4d8a8210b05d', '22e3c766-a65c-41a7-96d3-867baae04f4f', 'd81e4a27-04d5-449a-91cc-c6d5b7a0e287', 'f130151b-fd28-4dad-981a-fe66a1c8245d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:31 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-62b5cf9a-4998-4074-bbfe-6ef1c1a5059b tempest-GroupSnapshotsTest-696468924 None] group_snapshot ea661dd8-17e3-4a82-be5b-66e5050fa998: deleted successfully Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:31 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Flow 'volume_create_manager' (25d1638e-c23d-458f-9116-6dd85962bf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919fa021-756e-45d2-a9b1-51852d27b2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb34ebda-5a19-4bc7-a4e6-738d832feaaa" returned: 0 in 0.593s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.020s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-155556840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a7db8f-99b4-451d-b29d-910f591ef10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a81b5d2ec941b389dae6c5e4ce197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:31Z,use_quota=True,user_id='c71f1533fcf34ffaa71def384a666710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Creating volume 60a7db8f-99b4-451d-b29d-910f591ef10a {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:32 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:09:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-60a7db8f-99b4-451d-b29d-910f591ef10a 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919fa021-756e-45d2-a9b1-51852d27b2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1972221386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f02435-1610-42b3-a57b-bb19bb1d0198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a81b5d2ec941b389dae6c5e4ce197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:32Z,use_quota=True,user_id='c71f1533fcf34ffaa71def384a666710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55044b24-8528-451a-a01a-379e71255198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55044b24-8528-451a-a01a-379e71255198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:32 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-60a7db8f-99b4-451d-b29d-910f591ef10a 1073741824 Sep 28 16:09:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fee7622-f956-4ddd-8c76-5dc8ea09398a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fee7622-f956-4ddd-8c76-5dc8ea09398a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37f02435-1610-42b3-a57b-bb19bb1d0198', 'volume_name': 'volume-37f02435-1610-42b3-a57b-bb19bb1d0198', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:32 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e3c96d-1699-492f-8c32-3f8e41210a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e3c96d-1699-492f-8c32-3f8e41210a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720396ae-95ff-4ab3-b123-c517c4fed2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:32 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Volume 37f02435-1610-42b3-a57b-bb19bb1d0198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37f02435-1610-42b3-a57b-bb19bb1d0198', 'volume_size': 1} Sep 28 16:09:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30005407-4276-429a-9197-e3ad3d8c6758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb34ebda-5a19-4bc7-a4e6-738d832feaaa', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc1b1ea-b6f2-43b8-868b-824001eea757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:32 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Volume volume-eb34ebda-5a19-4bc7-a4e6-738d832feaaa (eb34ebda-5a19-4bc7-a4e6-738d832feaaa): created successfully Sep 28 16:09:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc1b1ea-b6f2-43b8-868b-824001eea757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Flow 'volume_create_manager' (6014e79c-d800-44f2-8f74-535951f7b9c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:32 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2175b1b3-ed3c-45dd-adcf-885e72034531 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Created volume successfully. Sep 28 16:09:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "cinder-quobyte-c41c9f3c-6d18-4079-81da-6882858dbc84" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-c41c9f3c-6d18-4079-81da-6882858dbc84" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:32 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-60a7db8f-99b4-451d-b29d-910f591ef10a 1073741824" returned: 0 in 1.006s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d249a59-62ea-42b0-9f27-23d2a3bef220]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-60a7db8f-99b4-451d-b29d-910f591ef10a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:33 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-60a7db8f-99b4-451d-b29d-910f591ef10a Sep 28 16:09:33 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:33 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84 Sep 28 16:09:33 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:33 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-60a7db8f-99b4-451d-b29d-910f591ef10a" returned: 0 in 0.411s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.255s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-366671497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2eaaed6-1950-42be-8137-57b74b8f3b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a81b5d2ec941b389dae6c5e4ce197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:31Z,use_quota=True,user_id='c71f1533fcf34ffaa71def384a666710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Creating volume d2eaaed6-1950-42be-8137-57b74b8f3b31 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:33 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d2eaaed6-1950-42be-8137-57b74b8f3b31 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5aebd4-5f30-45ce-8b19-d05f9850a8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60a7db8f-99b4-451d-b29d-910f591ef10a', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:33 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d2eaaed6-1950-42be-8137-57b74b8f3b31 1073741824 Sep 28 16:09:33 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:33 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de024341-4ada-4116-ba8f-14f3b48b9955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84" returned: 0 in 0.703s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:33 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Volume volume-60a7db8f-99b4-451d-b29d-910f591ef10a (60a7db8f-99b4-451d-b29d-910f591ef10a): created successfully Sep 28 16:09:33 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84 Sep 28 16:09:33 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de024341-4ada-4116-ba8f-14f3b48b9955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Flow 'volume_create_manager' (b4204269-921c-46d4-9af2-062e960ed84d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-055f8e6e-ace6-41fa-872b-2f2f28cef744 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Created volume successfully. Sep 28 16:09:34 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c41c9f3c-6d18-4079-81da-6882858dbc84" returned: 0 in 0.473s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-c41c9f3c-6d18-4079-81da-6882858dbc84" released by "delete_volume" :: held 1.366s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "cinder-quobyte-e0e9479b-949c-4284-ae05-bafad6e3220d" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-e0e9479b-949c-4284-ae05-bafad6e3220d" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50f5c90-626c-4c9d-a9e2-b583312219ec]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:34 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d2eaaed6-1950-42be-8137-57b74b8f3b31 1073741824" returned: 0 in 0.890s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:34 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d Sep 28 16:09:34 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d2eaaed6-1950-42be-8137-57b74b8f3b31 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:34 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d2eaaed6-1950-42be-8137-57b74b8f3b31 Sep 28 16:09:34 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:34 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_4scg26j2devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48" returned: 0 in 3.297s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_4scg26j2devstack@QuobyteHD, size 112.00 MB, duration 3.30 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:09:34 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Converted 112.00 MB image at 33.95 MB/s Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:34 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48 1G Sep 28 16:09:34 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:34 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d" returned: 0 in 0.474s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:34 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d Sep 28 16:09:34 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:34 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d2eaaed6-1950-42be-8137-57b74b8f3b31" returned: 0 in 0.375s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.800s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1972221386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f02435-1610-42b3-a57b-bb19bb1d0198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a81b5d2ec941b389dae6c5e4ce197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:32Z,use_quota=True,user_id='c71f1533fcf34ffaa71def384a666710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Creating volume 37f02435-1610-42b3-a57b-bb19bb1d0198 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:34 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:09:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-37f02435-1610-42b3-a57b-bb19bb1d0198 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:35 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-37f02435-1610-42b3-a57b-bb19bb1d0198 1073741824 Sep 28 16:09:35 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2bc5cb-4fc2-4574-8fff-9333706ffd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2eaaed6-1950-42be-8137-57b74b8f3b31', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc579fe-323a-4c95-95a2-d1d4cd89b815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:35 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Volume volume-d2eaaed6-1950-42be-8137-57b74b8f3b31 (d2eaaed6-1950-42be-8137-57b74b8f3b31): created successfully Sep 28 16:09:35 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:09:35 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc579fe-323a-4c95-95a2-d1d4cd89b815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Flow 'volume_create_manager' (66eef9b9-79d0-4dbe-a1b1-146f95624ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:35 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d2b1b894-384b-4315-92d1-816d92cee938 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Created volume successfully. Sep 28 16:09:35 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48 1G" returned: 0 in 0.574s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Downloaded image 7abc4afd-c71a-462f-b806-ba7da0f478cc ((None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}])) to volume 09976293-e74d-4058-bc1a-2b3baf50db48 successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Temporary image 7abc4afd-c71a-462f-b806-ba7da0f478cc for user 0de89530e0fc493097a1bf576ebfbd14 is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Marking volume 09976293-e74d-4058-bc1a-2b3baf50db48 as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Copying metadata from image 7abc4afd-c71a-462f-b806-ba7da0f478cc to 09976293-e74d-4058-bc1a-2b3baf50db48. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Creating volume glance metadata for volume 09976293-e74d-4058-bc1a-2b3baf50db48 backed by image 7abc4afd-c71a-462f-b806-ba7da0f478cc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:09:35 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e0e9479b-949c-4284-ae05-bafad6e3220d" returned: 0 in 0.546s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-e0e9479b-949c-4284-ae05-bafad6e3220d" released by "delete_volume" :: held 1.164s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f606f055-9fbf-4f05-8ece-ae3f345bc123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09976293-e74d-4058-bc1a-2b3baf50db48', 'volume_size': 1, 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3682e9714c0d4e0582fb2ca18f45f417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'created_at': datetime.datetime(2026, 9, 28, 13, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7abc4afd-c71a-462f-b806-ba7da0f478cc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:35 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (742bc126-ce2b-4fe2-801f-d9c0fb7615b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.679s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:09:35 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Volume volume-09976293-e74d-4058-bc1a-2b3baf50db48 (09976293-e74d-4058-bc1a-2b3baf50db48): created successfully Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (742bc126-ce2b-4fe2-801f-d9c0fb7615b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Flow 'volume_create_manager' (bca91070-e019-4316-aea5-552879332f1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:35 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-938ca47f-8d9d-4953-8455-68129f8f5873 tempest-VolumesExtendTest-393222218 None] Created volume successfully. Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Created reservations ['734b8eb7-e13d-492c-8db3-903a6c4865c3'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:35 devstack cinder-volume[87087]: WARNING cinder.quota [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-144894875 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-144894875, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:09:35 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-37f02435-1610-42b3-a57b-bb19bb1d0198 1073741824" returned: 0 in 0.906s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Created reservations ['8df71a67-4d86-4d47-a62b-b573befe3ef4', 'ed304151-e026-45ca-8e51-94e4e5fb57b5', 'a28421f4-116c-40ee-8d3c-148de9ae8512', '7e1b1206-1d97-4a44-b4f2-ade84c44a896'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-37f02435-1610-42b3-a57b-bb19bb1d0198 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:35 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-37f02435-1610-42b3-a57b-bb19bb1d0198 Sep 28 16:09:35 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Created reservations ['cb5efa0e-47fb-4e88-bd93-5487a6faf1cc', 'd7b8de05-e615-4b2a-8145-2d6478fb676a', 'f7053ac2-80d1-4311-8994-9a54f847ac67', '8aab510c-f858-4d2a-851a-3c4013feefdd'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:36 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:09:36 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:36 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-37f02435-1610-42b3-a57b-bb19bb1d0198" returned: 0 in 0.365s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720396ae-95ff-4ab3-b123-c517c4fed2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f02435-1610-42b3-a57b-bb19bb1d0198', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c19416f3-d7cc-430a-ab54-31bdb1aef142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:36 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Volume volume-37f02435-1610-42b3-a57b-bb19bb1d0198 (37f02435-1610-42b3-a57b-bb19bb1d0198): created successfully Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c19416f3-d7cc-430a-ab54-31bdb1aef142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Flow 'volume_create_manager' (25d1638e-c23d-458f-9116-6dd85962bf3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-636721b5-7941-4cc9-931f-c327a326959d tempest-CreateVolumesFromSnapshotTest-1775197516 None] Created volume successfully. Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e4723f2d-1da3-4458-85a4-6d79828bf9e3 tempest-VolumesExtendTest-393222218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e4723f2d-1da3-4458-85a4-6d79828bf9e3 tempest-VolumesExtendTest-393222218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4163d384-91ee-4fa0-9b71-056c03b8b2c9]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4723f2d-1da3-4458-85a4-6d79828bf9e3 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:36 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48 Sep 28 16:09:36 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:36 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.500s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ac2c4bc7-14cb-4642-a22a-ac98b65820e4 tempest-GroupSnapshotsTest-696468924 None] Delete group completed successfully. Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "cinder-37f02435-1610-42b3-a57b-bb19bb1d0198-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-37f02435-1610-42b3-a57b-bb19bb1d0198-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "cinder-quobyte-37f02435-1610-42b3-a57b-bb19bb1d0198" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-quobyte-37f02435-1610-42b3-a57b-bb19bb1d0198" acquired by "delete_volume" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd3fbd8-4527-4935-af58-186e23b9b339]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-37f02435-1610-42b3-a57b-bb19bb1d0198 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:37 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4723f2d-1da3-4458-85a4-6d79828bf9e3 tempest-VolumesExtendTest-393222218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48" returned: 0 in 0.608s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4723f2d-1da3-4458-85a4-6d79828bf9e3 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48 2G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:37 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-37f02435-1610-42b3-a57b-bb19bb1d0198 Sep 28 16:09:37 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4723f2d-1da3-4458-85a4-6d79828bf9e3 tempest-VolumesExtendTest-393222218 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48 2G" returned: 0 in 0.185s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e4723f2d-1da3-4458-85a4-6d79828bf9e3 tempest-VolumesExtendTest-393222218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.834s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e4723f2d-1da3-4458-85a4-6d79828bf9e3 tempest-VolumesExtendTest-393222218 None] Extend volume completed successfully. Sep 28 16:09:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a4a9c42e-ceab-48e1-bb3b-9369c9cd2505 tempest-GroupSnapshotsTest-696468924 None] Group tempest-GroupSnapshotsTest-Group-161405789: creating Sep 28 16:09:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a4a9c42e-ceab-48e1-bb3b-9369c9cd2505 tempest-GroupSnapshotsTest-696468924 None] Group tempest-GroupSnapshotsTest-Group-161405789: created successfully Sep 28 16:09:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a4a9c42e-ceab-48e1-bb3b-9369c9cd2505 tempest-GroupSnapshotsTest-696468924 None] Create group completed successfully. Sep 28 16:09:37 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-37f02435-1610-42b3-a57b-bb19bb1d0198" returned: 0 in 0.939s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-37f02435-1610-42b3-a57b-bb19bb1d0198 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:38 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-37f02435-1610-42b3-a57b-bb19bb1d0198 Sep 28 16:09:38 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] Acquiring lock "cinder-09976293-e74d-4058-bc1a-2b3baf50db48-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] Lock "cinder-09976293-e74d-4058-bc1a-2b3baf50db48-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] Acquiring lock "cinder-quobyte-09976293-e74d-4058-bc1a-2b3baf50db48" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] Lock "cinder-quobyte-09976293-e74d-4058-bc1a-2b3baf50db48" acquired by "delete_volume" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:38 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[162651ba-0c2a-493c-a139-742a52447af2]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:38 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-37f02435-1610-42b3-a57b-bb19bb1d0198" returned: 0 in 0.736s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-quobyte-37f02435-1610-42b3-a57b-bb19bb1d0198" released by "delete_volume" :: held 1.762s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:38 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48 Sep 28 16:09:38 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:38 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Created reservations ['5b003636-dfa5-4dad-a2a3-6e03d5f05931', '96d6a3a8-2903-4176-b51a-2345c16b6a20', '9aed44d3-b7ce-44ce-978a-ef2efca42260', '3f35b92c-22eb-4373-9251-32f138d63160'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:39 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:09:39 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:39 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48" returned: 0 in 0.671s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:39 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48 Sep 28 16:09:39 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "cinder-d2eaaed6-1950-42be-8137-57b74b8f3b31-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-d2eaaed6-1950-42be-8137-57b74b8f3b31-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "cinder-quobyte-d2eaaed6-1950-42be-8137-57b74b8f3b31" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-quobyte-d2eaaed6-1950-42be-8137-57b74b8f3b31" acquired by "delete_volume" :: waited 0.052s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e108e16-d0c6-436d-ad6c-64f9897ff7b4]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d2eaaed6-1950-42be-8137-57b74b8f3b31 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:39 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.622s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Deleted volume successfully. Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-06971580-ba51-4197-ac2d-259bdff66a65 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-37f02435-1610-42b3-a57b-bb19bb1d0198-delete_volume" released by "delete_volume" :: held 2.804s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:39 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-09976293-e74d-4058-bc1a-2b3baf50db48" returned: 0 in 0.588s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] Lock "cinder-quobyte-09976293-e74d-4058-bc1a-2b3baf50db48" released by "delete_volume" :: held 1.353s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:39 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d2eaaed6-1950-42be-8137-57b74b8f3b31 Sep 28 16:09:39 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:39 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] Created reservations ['25220034-36f5-4701-80ef-f062739fa499', 'c02d4816-d17d-4ef5-ba39-7d18f7816b58', '19d6c74d-2ccd-42b1-a248-c053be7ca43d', '8ada809b-4e10-4947-959c-3da99748f517'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Flow 'volume_create_manager' (54be3aa8-6457-4985-b8c4-d58e071336de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc87480-86ab-4520-b680-64a2a96839fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc87480-86ab-4520-b680-64a2a96839fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-596874709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0607775-deb0-4fa3-ad60-ac2f9014462f,host='devstack@QuobyteHD#QuobyteHD',id=8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d92cb2b55a49a7b66431db4a34a3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:40Z,use_quota=True,user_id='0180a068d2ce428a870f66da4ddd4f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51c6bb59-7966-40b3-9e6c-994b7b73d529),volume_type_id=51c6bb59-7966-40b3-9e6c-994b7b73d529)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54aecbd-d0e3-4c14-a3d7-e124ba0e675d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54aecbd-d0e3-4c14-a3d7-e124ba0e675d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fde767-4a78-4d71-be5a-069239bf0f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fde767-4a78-4d71-be5a-069239bf0f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410', 'volume_name': 'volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63ee298-df0b-43ac-9460-3dab3d5f36a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63ee298-df0b-43ac-9460-3dab3d5f36a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a472fe02-c8d2-4127-85b5-87e1032e4f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:40 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Volume 8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410', 'volume_size': 1} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d0607775-deb0-4fa3-ad60-ac2f9014462f,created_at=2026-09-28T14:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-596874709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0607775-deb0-4fa3-ad60-ac2f9014462f,host='devstack@QuobyteHD#QuobyteHD',id=8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d92cb2b55a49a7b66431db4a34a3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:40Z,use_quota=True,user_id='0180a068d2ce428a870f66da4ddd4f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51c6bb59-7966-40b3-9e6c-994b7b73d529),volume_type_id=51c6bb59-7966-40b3-9e6c-994b7b73d529)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Creating volume 8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:40 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:40 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 1073741824 Sep 28 16:09:40 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:40 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:09:40 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:40 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d2eaaed6-1950-42be-8137-57b74b8f3b31" returned: 0 in 0.721s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d2eaaed6-1950-42be-8137-57b74b8f3b31 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:40 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d2eaaed6-1950-42be-8137-57b74b8f3b31 Sep 28 16:09:40 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:40 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.385s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:40 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] Deleted volume successfully. Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9a4ca862-4205-43ec-975a-c4bb273a28dd tempest-VolumesExtendTest-393222218 None] Lock "cinder-09976293-e74d-4058-bc1a-2b3baf50db48-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:40 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d2eaaed6-1950-42be-8137-57b74b8f3b31" returned: 0 in 0.445s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-quobyte-d2eaaed6-1950-42be-8137-57b74b8f3b31" released by "delete_volume" :: held 1.287s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:40 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] Created reservations ['720a0a68-1bab-4d50-b2a5-b5024d67d2f6', '2e8160d2-054f-4b0a-8b56-2c6610d4d588', '43cfc8f9-41ac-4d63-809a-d3fe5d142575', '36aaf0c0-cd1b-4b9d-9bf9-d675002a827d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:40 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 1073741824" returned: 0 in 0.737s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:41 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 Sep 28 16:09:41 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:41 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:09:41 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:41 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410" returned: 0 in 0.760s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a472fe02-c8d2-4127-85b5-87e1032e4f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ec259c-7796-42ed-9824-c21974761654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:41 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Volume volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 (8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410): created successfully Sep 28 16:09:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ec259c-7796-42ed-9824-c21974761654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:41 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Flow 'volume_create_manager' (54be3aa8-6457-4985-b8c4-d58e071336de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.900s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:41 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "cinder-60a7db8f-99b4-451d-b29d-910f591ef10a-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] Deleted volume successfully. Sep 28 16:09:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9777163e-70f1-471b-8b1c-b515541b50bd tempest-GroupSnapshotsTest-696468924 None] Created volume successfully. Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-60a7db8f-99b4-451d-b29d-910f591ef10a-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-94ba9bdb-0d51-47b7-8542-13454667cbea tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-d2eaaed6-1950-42be-8137-57b74b8f3b31-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Flow 'volume_create_manager' (9977f655-75bf-4a3e-9058-539c74f06cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da449d5f-3437-4989-95f5-de85a2081c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da449d5f-3437-4989-95f5-de85a2081c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1999747660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3363e362-a83a-4dbf-b7f1-5171742ebb4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2036854d584352a5f85f77007e9575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:42Z,use_quota=True,user_id='0de89530e0fc493097a1bf576ebfbd14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce0d1b7-6d39-4488-a5ef-74f405c0a247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce0d1b7-6d39-4488-a5ef-74f405c0a247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b04e39-fd96-4241-9653-d3ce78225db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b04e39-fd96-4241-9653-d3ce78225db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3363e362-a83a-4dbf-b7f1-5171742ebb4a', 'volume_name': 'volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a94b98c6-d915-4ea7-aae4-cba79fc59642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a94b98c6-d915-4ea7-aae4-cba79fc59642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd95f3f-ed7a-429c-9a7d-a1ed6678be75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:42 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Volume 3363e362-a83a-4dbf-b7f1-5171742ebb4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a', 'volume_size': 1} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1999747660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3363e362-a83a-4dbf-b7f1-5171742ebb4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2036854d584352a5f85f77007e9575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:42Z,use_quota=True,user_id='0de89530e0fc493097a1bf576ebfbd14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Creating volume 3363e362-a83a-4dbf-b7f1-5171742ebb4a {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:42 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:42 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a 1073741824 Sep 28 16:09:42 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "cinder-quobyte-60a7db8f-99b4-451d-b29d-910f591ef10a" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-quobyte-60a7db8f-99b4-451d-b29d-910f591ef10a" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b66363-6433-48e2-b2bf-311a24dc60c3]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-60a7db8f-99b4-451d-b29d-910f591ef10a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:42 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-60a7db8f-99b4-451d-b29d-910f591ef10a Sep 28 16:09:42 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:42 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-60a7db8f-99b4-451d-b29d-910f591ef10a" returned: 0 in 0.497s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-60a7db8f-99b4-451d-b29d-910f591ef10a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:42 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a 1073741824" returned: 0 in 0.619s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:42 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-60a7db8f-99b4-451d-b29d-910f591ef10a Sep 28 16:09:42 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:43 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a Sep 28 16:09:43 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:43 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-60a7db8f-99b4-451d-b29d-910f591ef10a" returned: 0 in 0.546s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-quobyte-60a7db8f-99b4-451d-b29d-910f591ef10a" released by "delete_volume" :: held 1.110s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=107,cinder:UPDATE=121,cinder:DELETE=9,cinder:INSERT=33 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Created reservations ['75e6f909-63e4-4cfd-b8ab-df2615807fc4', 'fb165284-8254-4248-be16-2dd853c28981', '5d7103a7-41cc-49e8-9ac9-7946546f927e', '40adf055-a0b8-4d1c-91e0-072e29be0e40'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:43 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a" returned: 0 in 0.672s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:43 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] GroupSnapshot 934de715-dba2-4016-b6ec-f35858e42205: creating. Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd95f3f-ed7a-429c-9a7d-a1ed6678be75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff1095d-de3f-435b-8ec9-9495f99faf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:43 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Volume volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a (3363e362-a83a-4dbf-b7f1-5171742ebb4a): created successfully Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff1095d-de3f-435b-8ec9-9495f99faf1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Flow 'volume_create_manager' (9977f655-75bf-4a3e-9058-539c74f06cdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] Group snapshot 934de715-dba2-4016-b6ec-f35858e42205: creating. {{(pid=87087) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:43 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6249efca-2eab-43ad-83fc-e110b0774f86 tempest-VolumesExtendTest-393222218 None] Created volume successfully. Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:43 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:09:43 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] Creating offline snapshot e6f0a40f-ab6a-4767-b5cc-42f4a9efe069 of volume 8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcdb182-15c0-41e5-b67c-a7f2d316c1cd]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:44 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 Sep 28 16:09:44 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:44 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.418s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:44 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:44 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Deleted volume successfully. Sep 28 16:09:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-392ce263-01a3-4b79-ac2a-9c1cce9ab9f7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-60a7db8f-99b4-451d-b29d-910f591ef10a-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "cinder-eb34ebda-5a19-4bc7-a4e6-738d832feaaa-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-eb34ebda-5a19-4bc7-a4e6-738d832feaaa-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-adf87ea9-f4dd-4633-aa80-5dbaa23b0274 tempest-VolumesExtendTest-393222218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "cinder-quobyte-eb34ebda-5a19-4bc7-a4e6-738d832feaaa" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-quobyte-eb34ebda-5a19-4bc7-a4e6-738d832feaaa" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:44 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410" returned: 0 in 0.949s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:44 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[960a1a5c-fc13-416a-acc5-809ec6db34b5]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb34ebda-5a19-4bc7-a4e6-738d832feaaa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:44 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069 1G Sep 28 16:09:44 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:45 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb34ebda-5a19-4bc7-a4e6-738d832feaaa Sep 28 16:09:45 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:45 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb34ebda-5a19-4bc7-a4e6-738d832feaaa" returned: 0 in 0.619s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb34ebda-5a19-4bc7-a4e6-738d832feaaa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:45 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069 1G" returned: 0 in 0.651s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:45 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb34ebda-5a19-4bc7-a4e6-738d832feaaa Sep 28 16:09:45 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:45 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069 Sep 28 16:09:45 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:45 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eb34ebda-5a19-4bc7-a4e6-738d832feaaa" returned: 0 in 0.420s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-quobyte-eb34ebda-5a19-4bc7-a4e6-738d832feaaa" released by "delete_volume" :: held 1.137s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:46 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069" returned: 0 in 0.481s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:46 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:09:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:46 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069 Sep 28 16:09:46 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:46 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Created reservations ['21a82ab9-b664-4508-ac88-56ac29d36814', '680e3e64-fd0d-4a3e-b880-6bbd89fb55d7', '82f568ad-97fd-4338-8099-878546cb6630', 'c09f7f85-ddac-4f64-bded-10a464e4a156'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:46 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:09:46 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:46 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069" returned: 0 in 0.393s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:46 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.info Sep 28 16:09:46 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:46 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.325s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:46 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:46 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Deleted volume successfully. Sep 28 16:09:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-61dd5e84-fac9-465a-b239-5e41afb7fa02 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-eb34ebda-5a19-4bc7-a4e6-738d832feaaa-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:46 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.info" returned: 0 in 0.355s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:46 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:09:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:46 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.info Sep 28 16:09:46 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:47 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.info" returned: 0 in 0.290s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "cinder-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.274s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-adf87ea9-f4dd-4633-aa80-5dbaa23b0274 tempest-VolumesExtendTest-393222218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.319s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-adf87ea9-f4dd-4633-aa80-5dbaa23b0274 tempest-VolumesExtendTest-393222218 None] Creating offline snapshot 01b1f26f-7779-452b-b6a2-a291d60a32f3 of volume 3363e362-a83a-4dbf-b7f1-5171742ebb4a {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:09:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:47 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dbac23-b76c-4b64-ba5d-88a07042900e]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-adf87ea9-f4dd-4633-aa80-5dbaa23b0274 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "cinder-quobyte-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-quobyte-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc" acquired by "delete_volume" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d1888919-230c-4c1e-9ebc-21dd9b9b1a15 tempest-GroupSnapshotsTest-696468924 None] group_snapshot 934de715-dba2-4016-b6ec-f35858e42205: created successfully Sep 28 16:09:47 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f9842c-f1c2-4d12-a190-aa1a8510f7d2]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:47 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a Sep 28 16:09:47 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:47 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc Sep 28 16:09:47 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:47 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-adf87ea9-f4dd-4633-aa80-5dbaa23b0274 tempest-VolumesExtendTest-393222218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a" returned: 0 in 0.466s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-adf87ea9-f4dd-4633-aa80-5dbaa23b0274 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:47 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3 1G Sep 28 16:09:47 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:47 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc" returned: 0 in 0.512s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:47 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc Sep 28 16:09:47 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:48 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc" returned: 0 in 0.355s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-adf87ea9-f4dd-4633-aa80-5dbaa23b0274 tempest-VolumesExtendTest-393222218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3 1G" returned: 0 in 0.575s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-adf87ea9-f4dd-4633-aa80-5dbaa23b0274 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:48 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-quobyte-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc" released by "delete_volume" :: held 0.952s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:48 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3 Sep 28 16:09:48 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:48 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] group_snapshot 934de715-dba2-4016-b6ec-f35858e42205: deleting Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] group_snapshot 934de715-dba2-4016-b6ec-f35858e42205: deleting {{(pid=87087) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Created reservations ['3459679c-5424-4b58-9219-a7fc7bc1f1fd', 'bac185b3-f76a-488e-b8a3-b16cade3d164', 'd02b080b-e6d0-4a38-b3d5-e2ae8881f7f6', 'faf3fea8-d8f0-4854-9aaf-4c23243864d7'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "cinder-quobyte-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "cinder-quobyte-e6f0a40f-ab6a-4767-b5cc-42f4a9efe069" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-e6f0a40f-ab6a-4767-b5cc-42f4a9efe069" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] Deleting offline snapshot e6f0a40f-ab6a-4767-b5cc-42f4a9efe069 of volume 8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] snapshot_file for this snap is: volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c362295c-9de5-47b9-a20e-e8c977a535e6]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:48 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:09:48 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:48 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069 Sep 28 16:09:48 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:48 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-adf87ea9-f4dd-4633-aa80-5dbaa23b0274 tempest-VolumesExtendTest-393222218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3" returned: 0 in 0.631s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:48 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-adf87ea9-f4dd-4633-aa80-5dbaa23b0274 tempest-VolumesExtendTest-393222218 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3 is being set with open permissions: ugo+rw Sep 28 16:09:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-adf87ea9-f4dd-4633-aa80-5dbaa23b0274 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:48 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3 Sep 28 16:09:48 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:49 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.325s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Deleted volume successfully. Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3d137d89-5bb6-4b1d-8198-55b3c7118110 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-a4a22d79-40e8-4df7-b9e9-aedef1cb23dc-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:49 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069" returned: 0 in 0.578s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8af938-6bcc-4d9d-878e-9b2997da469a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:49 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-adf87ea9-f4dd-4633-aa80-5dbaa23b0274 tempest-VolumesExtendTest-393222218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3" returned: 0 in 0.343s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-adf87ea9-f4dd-4633-aa80-5dbaa23b0274 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:49 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 Sep 28 16:09:49 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:49 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.info Sep 28 16:09:49 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "cinder-b3c7c15f-8ad7-4a75-b408-8e9efd617d31-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-b3c7c15f-8ad7-4a75-b408-8e9efd617d31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "cinder-quobyte-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-quobyte-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "cinder-quobyte-b3c7c15f-8ad7-4a75-b408-8e9efd617d31" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-quobyte-b3c7c15f-8ad7-4a75-b408-8e9efd617d31" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] Deleting offline snapshot b3c7c15f-8ad7-4a75-b408-8e9efd617d31 of volume eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] snapshot_file for this snap is: volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e898b4-41a9-42b9-9f36-90135a3065b5]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:49 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-adf87ea9-f4dd-4633-aa80-5dbaa23b0274 tempest-VolumesExtendTest-393222218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.info" returned: 0 in 0.353s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:49 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-adf87ea9-f4dd-4633-aa80-5dbaa23b0274 tempest-VolumesExtendTest-393222218 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.info is being set with open permissions: ugo+rw Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-adf87ea9-f4dd-4633-aa80-5dbaa23b0274 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:49 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.info Sep 28 16:09:49 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:49 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410" returned: 0 in 0.532s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:49 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069 Sep 28 16:09:49 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:49 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31 Sep 28 16:09:49 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:50 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-adf87ea9-f4dd-4633-aa80-5dbaa23b0274 tempest-VolumesExtendTest-393222218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.info" returned: 0 in 0.444s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-adf87ea9-f4dd-4633-aa80-5dbaa23b0274 tempest-VolumesExtendTest-393222218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.963s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:50 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31" returned: 0 in 0.516s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:09:50 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-adf87ea9-f4dd-4633-aa80-5dbaa23b0274 tempest-VolumesExtendTest-393222218 None] Create snapshot completed successfully Sep 28 16:09:50 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f024443-73a5-42c0-b4a9-05483de93887]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:50 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069" returned: 0 in 0.489s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:50 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069 Sep 28 16:09:50 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:50 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 Sep 28 16:09:50 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:50 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410.e6f0a40f-ab6a-4767-b5cc-42f4a9efe069" returned: 0 in 0.298s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-e6f0a40f-ab6a-4767-b5cc-42f4a9efe069" released by "_delete_snapshot" :: held 2.080s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410" released by "delete_snapshot" :: held 2.132s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:50 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5" returned: 0 in 0.509s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:50 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31 Sep 28 16:09:50 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:50 devstack cinder-volume[87087]: WARNING cinder.quota [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-704598186 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-704598186, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:09:50 devstack cinder-volume[87087]: WARNING cinder.quota [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-704598186 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-704598186, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:09:50 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] Created reservations ['5ac5da16-e2ae-42b3-8d59-651c659c1b00', '68646f26-5117-4b89-8f2e-dba8c942af92', '011c2bac-a40e-44df-803d-1b7b3cfa0862', '4151e9ad-466f-45b3-b25b-19f591bb0eaf'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:50 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8bd8d20d-013c-402c-bb2f-a1b52f6f58b5 tempest-GroupSnapshotsTest-696468924 None] group_snapshot 934de715-dba2-4016-b6ec-f35858e42205: deleted successfully Sep 28 16:09:51 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31" returned: 0 in 0.500s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:51 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31 Sep 28 16:09:51 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7a198990-64a0-46e7-90c5-3d49f43dcfa5 tempest-VolumesExtendTest-393222218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7a198990-64a0-46e7-90c5-3d49f43dcfa5 tempest-VolumesExtendTest-393222218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:51 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2285aa63-68a2-4728-9de5-7b3741cf04b2]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7a198990-64a0-46e7-90c5-3d49f43dcfa5 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:51 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a Sep 28 16:09:51 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:51 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5.b3c7c15f-8ad7-4a75-b408-8e9efd617d31" returned: 0 in 0.318s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-quobyte-b3c7c15f-8ad7-4a75-b408-8e9efd617d31" released by "_delete_snapshot" :: held 2.032s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-quobyte-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5" released by "delete_snapshot" :: held 2.072s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:51 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] Created reservations ['0ef59a82-bbcc-4fd5-8a2e-9cadace9dddb', '64020baa-2bac-4461-b2ba-c881ea3e428e', '0c32956f-afc0-4e37-b2d1-3895361ae95a', '1d484813-46f5-4c80-ba6b-ab7848db6a2c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:51 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7a198990-64a0-46e7-90c5-3d49f43dcfa5 tempest-VolumesExtendTest-393222218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a" returned: 0 in 0.446s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7a198990-64a0-46e7-90c5-3d49f43dcfa5 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3 2G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:51 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] Delete snapshot completed successfully. Sep 28 16:09:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-840f0de5-7738-461c-9233-37cd6b5fa60b tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-b3c7c15f-8ad7-4a75-b408-8e9efd617d31-delete_snapshot" released by "delete_snapshot" :: held 2.305s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7a198990-64a0-46e7-90c5-3d49f43dcfa5 tempest-VolumesExtendTest-393222218 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3 2G" returned: 0 in 0.176s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7a198990-64a0-46e7-90c5-3d49f43dcfa5 tempest-VolumesExtendTest-393222218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.677s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:52 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7a198990-64a0-46e7-90c5-3d49f43dcfa5 tempest-VolumesExtendTest-393222218 None] Extend volume completed successfully. Sep 28 16:09:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3263e93f-1002-477d-9b0d-1a60f32f0fe3 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "cinder-quobyte-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3263e93f-1002-477d-9b0d-1a60f32f0fe3 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410" acquired by "delete_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:52 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5987c591-0cf7-4bce-be92-92f5cdff783b]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3263e93f-1002-477d-9b0d-1a60f32f0fe3 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:52 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 Sep 28 16:09:52 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] Acquiring lock "cinder-01b1f26f-7779-452b-b6a2-a291d60a32f3-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] Lock "cinder-01b1f26f-7779-452b-b6a2-a291d60a32f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] Acquiring lock "cinder-quobyte-3363e362-a83a-4dbf-b7f1-5171742ebb4a" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] Lock "cinder-quobyte-3363e362-a83a-4dbf-b7f1-5171742ebb4a" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] Acquiring lock "cinder-quobyte-01b1f26f-7779-452b-b6a2-a291d60a32f3" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] Lock "cinder-quobyte-01b1f26f-7779-452b-b6a2-a291d60a32f3" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] Deleting offline snapshot 01b1f26f-7779-452b-b6a2-a291d60a32f3 of volume 3363e362-a83a-4dbf-b7f1-5171742ebb4a {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:09:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] snapshot_file for this snap is: volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:09:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "cinder-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:52 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f9fb1c-4186-46d0-8eff-ad0af35fd765]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "cinder-quobyte-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-quobyte-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:52 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:52 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3 Sep 28 16:09:52 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3263e93f-1002-477d-9b0d-1a60f32f0fe3 tempest-GroupSnapshotsTest-696468924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410" returned: 0 in 0.613s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3263e93f-1002-477d-9b0d-1a60f32f0fe3 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c24ddc8-4f94-4274-88f8-8ee4516cd109]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:53 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410 Sep 28 16:09:53 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:53 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 Sep 28 16:09:53 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:53 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3" returned: 0 in 0.511s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:09:53 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3263e93f-1002-477d-9b0d-1a60f32f0fe3 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410" returned: 0 in 0.339s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[249744b1-c643-44fe-85c8-7e10dd40671c]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3263e93f-1002-477d-9b0d-1a60f32f0fe3 tempest-GroupSnapshotsTest-696468924 None] Lock "cinder-quobyte-8c2fe6f2-a9ad-4a08-8d84-e40f3ef8d410" released by "delete_volume" :: held 1.068s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-3263e93f-1002-477d-9b0d-1a60f32f0fe3 tempest-GroupSnapshotsTest-696468924 None] Created reservations ['2eb72342-6c56-4f6b-8bef-339619936538'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:53 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a Sep 28 16:09:53 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:53 devstack cinder-volume[87087]: WARNING cinder.quota [None req-3263e93f-1002-477d-9b0d-1a60f32f0fe3 tempest-GroupSnapshotsTest-696468924 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-704598186 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-704598186, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-3263e93f-1002-477d-9b0d-1a60f32f0fe3 tempest-GroupSnapshotsTest-696468924 None] Created reservations ['e9eef442-9f66-4a43-b1fd-1658f1fa9613', '240f609e-bd73-4862-949b-b172e981e5e0', '556eb719-d525-47ec-86c4-d4dcd9158459', '0a28612e-5019-4c55-af18-d4bec5f2a4e9'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:53 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5" returned: 0 in 0.657s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:53 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5 Sep 28 16:09:53 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3263e93f-1002-477d-9b0d-1a60f32f0fe3 tempest-GroupSnapshotsTest-696468924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3263e93f-1002-477d-9b0d-1a60f32f0fe3 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3263e93f-1002-477d-9b0d-1a60f32f0fe3 tempest-GroupSnapshotsTest-696468924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3263e93f-1002-477d-9b0d-1a60f32f0fe3 tempest-GroupSnapshotsTest-696468924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3263e93f-1002-477d-9b0d-1a60f32f0fe3 tempest-GroupSnapshotsTest-696468924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3263e93f-1002-477d-9b0d-1a60f32f0fe3 tempest-GroupSnapshotsTest-696468924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:53 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:09:53 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:54 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a" returned: 0 in 0.715s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:54 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5" returned: 0 in 0.407s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:54 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3 Sep 28 16:09:54 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-quobyte-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5" released by "delete_volume" :: held 1.162s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:54 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Created reservations ['7f6efaba-c0f5-43e0-a29c-a4bf3f88e159', '0d52de73-6d8c-4ce9-8bf8-e131ce52d27c', '0654eb45-4bf3-43a1-a9ae-ee6591476d51', 'bab1838a-4301-4059-9aca-cfe4b32b88f6'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:54 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3263e93f-1002-477d-9b0d-1a60f32f0fe3 tempest-GroupSnapshotsTest-696468924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.486s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:54 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-3263e93f-1002-477d-9b0d-1a60f32f0fe3 tempest-GroupSnapshotsTest-696468924 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:54 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:09:54 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3263e93f-1002-477d-9b0d-1a60f32f0fe3 tempest-GroupSnapshotsTest-696468924 None] Delete group completed successfully. Sep 28 16:09:54 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:54 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3" returned: 0 in 0.535s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:54 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3 Sep 28 16:09:54 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:54 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.356s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:54 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:54 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Deleted volume successfully. Sep 28 16:09:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f6151e2d-b93b-4f29-8d13-02051f085ba7 tempest-CreateVolumesFromSnapshotTest-1775197516 None] Lock "cinder-eac02c0d-faa7-4b8c-a30d-ee92d20bf3a5-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:54 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a.01b1f26f-7779-452b-b6a2-a291d60a32f3" returned: 0 in 0.329s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] Lock "cinder-quobyte-01b1f26f-7779-452b-b6a2-a291d60a32f3" released by "_delete_snapshot" :: held 2.313s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] Lock "cinder-quobyte-3363e362-a83a-4dbf-b7f1-5171742ebb4a" released by "delete_snapshot" :: held 2.356s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:55 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] Created reservations ['73ed263e-2a1b-496d-b0d2-6197ea8e4eb9', '0787a5a1-408a-49bf-a13a-c8b23994ff12', '897e9200-51c5-4b63-9618-0f845cb7c9e2', '36301808-1778-4f10-9c59-226cbe9ba36a'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:55 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] Delete snapshot completed successfully. Sep 28 16:09:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0fa4227c-be6c-43d4-bd5a-b1d18f7161e4 tempest-VolumesExtendTest-393222218 None] Lock "cinder-01b1f26f-7779-452b-b6a2-a291d60a32f3-delete_snapshot" released by "delete_snapshot" :: held 2.632s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] Acquiring lock "cinder-3363e362-a83a-4dbf-b7f1-5171742ebb4a-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] Lock "cinder-3363e362-a83a-4dbf-b7f1-5171742ebb4a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] Acquiring lock "cinder-quobyte-3363e362-a83a-4dbf-b7f1-5171742ebb4a" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] Lock "cinder-quobyte-3363e362-a83a-4dbf-b7f1-5171742ebb4a" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:56 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f239b97-ee51-47bd-813d-7f44dec73916]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:56 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a Sep 28 16:09:56 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:56 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a" returned: 0 in 0.546s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:56 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a Sep 28 16:09:56 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:57 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3363e362-a83a-4dbf-b7f1-5171742ebb4a" returned: 0 in 0.364s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] Lock "cinder-quobyte-3363e362-a83a-4dbf-b7f1-5171742ebb4a" released by "delete_volume" :: held 1.002s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:57 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] Created reservations ['64c22193-e9c3-4fe1-9861-e8b5684d2410', 'a9588afc-fcea-4d3a-bd0f-3f0a17af1176', '1bc61abd-9e1b-427f-a4aa-654ef3aeedd9', 'dd05c2cd-00a7-45e7-9eff-514bb94232c9'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:57 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:09:57 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:57 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.351s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:57 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] Deleted volume successfully. Sep 28 16:09:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b22c5937-29d1-4f3a-885e-dbabb903caec tempest-VolumesExtendTest-393222218 None] Lock "cinder-3363e362-a83a-4dbf-b7f1-5171742ebb4a-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Flow 'volume_create_manager' (86235a2d-6190-477f-a0b5-abb71b80a491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be1b703-513f-44da-a4fb-e7e5fb14a262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be1b703-513f-44da-a4fb-e7e5fb14a262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-433689675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21760d0356374ad4b3537cbf266e15af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:05Z,use_quota=True,user_id='2a3a67ce00a148afa538fbf55492d732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39cdc7f-3e8d-4931-8393-2b9464897c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39cdc7f-3e8d-4931-8393-2b9464897c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2ad979-0696-47fe-bc43-9ef8b1213ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2ad979-0696-47fe-bc43-9ef8b1213ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd', 'volume_name': 'volume-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f8b4d3-34ce-4786-a777-9723550b84e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f8b4d3-34ce-4786-a777-9723550b84e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce841df-9031-4d86-a4d1-fde7c4b92aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:05 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Volume 3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd', 'volume_size': 1} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-433689675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21760d0356374ad4b3537cbf266e15af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:05Z,use_quota=True,user_id='2a3a67ce00a148afa538fbf55492d732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Creating volume 3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:05 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:10:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:05 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd 1073741824 Sep 28 16:10:05 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Flow 'volume_create_manager' (58fcfd75-fe28-4cff-a88a-8918741ebc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc5f253-ae59-42a4-922b-183f92b05a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc5f253-ae59-42a4-922b-183f92b05a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2068592588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5aba2e0-52a1-4545-bfe3-7b1854383bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c222d31ec51848279de98269d6837905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:06Z,use_quota=True,user_id='08f9986f124e440a84f9020544ba598f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b6c49b-f892-42ab-9faf-822881e85776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b6c49b-f892-42ab-9faf-822881e85776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2f3b64-ba91-4567-960b-3d16e5a9c92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2f3b64-ba91-4567-960b-3d16e5a9c92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5aba2e0-52a1-4545-bfe3-7b1854383bd2', 'volume_name': 'volume-f5aba2e0-52a1-4545-bfe3-7b1854383bd2', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:06 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78c2679-a530-458b-a1c6-a30e8be28f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78c2679-a530-458b-a1c6-a30e8be28f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03bcd301-fdb0-45f6-8312-3b29ce53d3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:06 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Volume f5aba2e0-52a1-4545-bfe3-7b1854383bd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5aba2e0-52a1-4545-bfe3-7b1854383bd2', 'volume_size': 1} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd 1073741824" returned: 0 in 0.764s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:06 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd Sep 28 16:10:06 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:06 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd" returned: 0 in 0.349s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.396s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2068592588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5aba2e0-52a1-4545-bfe3-7b1854383bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c222d31ec51848279de98269d6837905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:06Z,use_quota=True,user_id='08f9986f124e440a84f9020544ba598f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Creating volume f5aba2e0-52a1-4545-bfe3-7b1854383bd2 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:06 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f5aba2e0-52a1-4545-bfe3-7b1854383bd2 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:06 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f5aba2e0-52a1-4545-bfe3-7b1854383bd2 1073741824 Sep 28 16:10:06 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce841df-9031-4d86-a4d1-fde7c4b92aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c9d193-464d-4edf-ace5-c53d8d725ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:06 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Volume volume-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd (3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd): created successfully Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c9d193-464d-4edf-ace5-c53d8d725ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Flow 'volume_create_manager' (86235a2d-6190-477f-a0b5-abb71b80a491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:06 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e7c3ca5d-7c1d-4a1d-8428-0055c9dc2a39 tempest-VolumesListTestJSON-938300630 None] Created volume successfully. Sep 28 16:10:07 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f5aba2e0-52a1-4545-bfe3-7b1854383bd2 1073741824" returned: 0 in 0.622s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:07 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=183,cinder:UPDATE=183,cinder:INSERT=52,cinder:DELETE=11 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:10:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f5aba2e0-52a1-4545-bfe3-7b1854383bd2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:07 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f5aba2e0-52a1-4545-bfe3-7b1854383bd2 Sep 28 16:10:07 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:07 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f5aba2e0-52a1-4545-bfe3-7b1854383bd2" returned: 0 in 0.420s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03bcd301-fdb0-45f6-8312-3b29ce53d3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5aba2e0-52a1-4545-bfe3-7b1854383bd2', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3d7d91-b5b3-418a-b559-ffb5c30d8519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:07 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Volume volume-f5aba2e0-52a1-4545-bfe3-7b1854383bd2 (f5aba2e0-52a1-4545-bfe3-7b1854383bd2): created successfully Sep 28 16:10:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3d7d91-b5b3-418a-b559-ffb5c30d8519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Flow 'volume_create_manager' (58fcfd75-fe28-4cff-a88a-8918741ebc07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b30ed3f2-800e-4414-9c90-fd3f019d8f26 tempest-AttachVolumeNegativeTest-429818067 None] Created volume successfully. Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Flow 'volume_create_manager' (51b993d1-48e9-45ff-b52c-552126442e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99379ec4-af49-4b1c-a128-5ea99e9753d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99379ec4-af49-4b1c-a128-5ea99e9753d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-787586224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6768661a-8385-489b-9edf-d58c825e0fe4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21760d0356374ad4b3537cbf266e15af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:08Z,use_quota=True,user_id='2a3a67ce00a148afa538fbf55492d732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b5b8cc-632a-460e-a9d1-62d25543a25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b5b8cc-632a-460e-a9d1-62d25543a25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a265e719-6458-4826-b992-28ce091a0ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a265e719-6458-4826-b992-28ce091a0ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6768661a-8385-489b-9edf-d58c825e0fe4', 'volume_name': 'volume-6768661a-8385-489b-9edf-d58c825e0fe4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d99ca6-8326-46d6-ab28-c000b98865e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d99ca6-8326-46d6-ab28-c000b98865e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7821d273-31fd-472c-b8c7-34cfc74a658e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:08 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Volume 6768661a-8385-489b-9edf-d58c825e0fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6768661a-8385-489b-9edf-d58c825e0fe4', 'volume_size': 1} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-787586224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6768661a-8385-489b-9edf-d58c825e0fe4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21760d0356374ad4b3537cbf266e15af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:08Z,use_quota=True,user_id='2a3a67ce00a148afa538fbf55492d732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Creating volume 6768661a-8385-489b-9edf-d58c825e0fe4 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:08 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:10:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6768661a-8385-489b-9edf-d58c825e0fe4 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:08 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6768661a-8385-489b-9edf-d58c825e0fe4 1073741824 Sep 28 16:10:08 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:09 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6768661a-8385-489b-9edf-d58c825e0fe4 1073741824" returned: 0 in 0.869s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6768661a-8385-489b-9edf-d58c825e0fe4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:09 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6768661a-8385-489b-9edf-d58c825e0fe4 Sep 28 16:10:09 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-a5709a84-4715-4dc2-8196-b25ddea30ef2 req-6dedb443-12af-4f64-bb3c-9f2836cc4c91 tempest-AttachVolumeNegativeTest-429818067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:09 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6768661a-8385-489b-9edf-d58c825e0fe4" returned: 0 in 0.331s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-a5709a84-4715-4dc2-8196-b25ddea30ef2 req-6dedb443-12af-4f64-bb3c-9f2836cc4c91 tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.273s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-a5709a84-4715-4dc2-8196-b25ddea30ef2 req-6dedb443-12af-4f64-bb3c-9f2836cc4c91 tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7821d273-31fd-472c-b8c7-34cfc74a658e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6768661a-8385-489b-9edf-d58c825e0fe4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192f8811-003e-4dc6-8f61-b4649677475e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:09 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Volume volume-6768661a-8385-489b-9edf-d58c825e0fe4 (6768661a-8385-489b-9edf-d58c825e0fe4): created successfully Sep 28 16:10:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192f8811-003e-4dc6-8f61-b4649677475e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Flow 'volume_create_manager' (51b993d1-48e9-45ff-b52c-552126442e3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:09 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-61e7a243-d981-4528-a95c-fe503c36b37a tempest-VolumesListTestJSON-938300630 None] Created volume successfully. Sep 28 16:10:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-a5709a84-4715-4dc2-8196-b25ddea30ef2 req-6dedb443-12af-4f64-bb3c-9f2836cc4c91 tempest-AttachVolumeNegativeTest-429818067 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-f5aba2e0-52a1-4545-bfe3-7b1854383bd2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6690601-bf0d-4a36-93ed-cf7fd64959b9', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:10:09 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-a5709a84-4715-4dc2-8196-b25ddea30ef2 req-6dedb443-12af-4f64-bb3c-9f2836cc4c91 tempest-AttachVolumeNegativeTest-429818067 None] attachment_update completed successfully. Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Flow 'volume_create_manager' (7502d4e5-8c4d-464b-be15-9c0871f3b9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d922ace-58e0-4578-94f2-e9401c205dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d922ace-58e0-4578-94f2-e9401c205dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-76354817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e73c67-2cee-43e0-a6fa-d423d434d769,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21760d0356374ad4b3537cbf266e15af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:11Z,use_quota=True,user_id='2a3a67ce00a148afa538fbf55492d732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8aa27fb-0c50-48fa-afbe-bb999c004c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8aa27fb-0c50-48fa-afbe-bb999c004c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84b4708-9519-42f8-b16f-9a94dfd9c28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84b4708-9519-42f8-b16f-9a94dfd9c28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26e73c67-2cee-43e0-a6fa-d423d434d769', 'volume_name': 'volume-26e73c67-2cee-43e0-a6fa-d423d434d769', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ba2746-f311-46d9-9f7b-00ff44d27ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ba2746-f311-46d9-9f7b-00ff44d27ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244886c4-9801-4ba7-9a4a-a5aa1ffb820e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:11 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Volume 26e73c67-2cee-43e0-a6fa-d423d434d769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26e73c67-2cee-43e0-a6fa-d423d434d769', 'volume_size': 1} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-76354817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e73c67-2cee-43e0-a6fa-d423d434d769,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21760d0356374ad4b3537cbf266e15af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:11Z,use_quota=True,user_id='2a3a67ce00a148afa538fbf55492d732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Creating volume 26e73c67-2cee-43e0-a6fa-d423d434d769 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:11 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:10:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-26e73c67-2cee-43e0-a6fa-d423d434d769 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:11 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-26e73c67-2cee-43e0-a6fa-d423d434d769 1073741824 Sep 28 16:10:11 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:12 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-26e73c67-2cee-43e0-a6fa-d423d434d769 1073741824" returned: 0 in 0.734s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-26e73c67-2cee-43e0-a6fa-d423d434d769 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:12 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-26e73c67-2cee-43e0-a6fa-d423d434d769 Sep 28 16:10:12 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:12 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-26e73c67-2cee-43e0-a6fa-d423d434d769" returned: 0 in 0.313s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244886c4-9801-4ba7-9a4a-a5aa1ffb820e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26e73c67-2cee-43e0-a6fa-d423d434d769', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99493b88-1820-4a8e-8d41-49131c5c9b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:12 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Volume volume-26e73c67-2cee-43e0-a6fa-d423d434d769 (26e73c67-2cee-43e0-a6fa-d423d434d769): created successfully Sep 28 16:10:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99493b88-1820-4a8e-8d41-49131c5c9b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Flow 'volume_create_manager' (7502d4e5-8c4d-464b-be15-9c0871f3b9b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-dbf173d2-53d9-4ec0-abd9-5ee3b9752ab1 tempest-VolumesListTestJSON-938300630 None] Created volume successfully. Sep 28 16:10:13 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-51abd0b1-f8aa-4e6e-9671-5fab62b30593 req-0934a88b-f80a-4d45-a788-3c2fd4d236a8 tempest-AttachVolumeNegativeTest-429818067 None] Terminate volume connection completed successfully. Sep 28 16:10:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-51abd0b1-f8aa-4e6e-9671-5fab62b30593 req-0934a88b-f80a-4d45-a788-3c2fd4d236a8 tempest-AttachVolumeNegativeTest-429818067 None] Deleting attachment c6690601-bf0d-4a36-93ed-cf7fd64959b9. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:10:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] Acquiring lock "cinder-26e73c67-2cee-43e0-a6fa-d423d434d769-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] Lock "cinder-26e73c67-2cee-43e0-a6fa-d423d434d769-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] Acquiring lock "cinder-quobyte-26e73c67-2cee-43e0-a6fa-d423d434d769" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] Lock "cinder-quobyte-26e73c67-2cee-43e0-a6fa-d423d434d769" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:17 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85ccf96-0a4d-49d3-917e-c73030e491e1]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-26e73c67-2cee-43e0-a6fa-d423d434d769 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:17 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-26e73c67-2cee-43e0-a6fa-d423d434d769 Sep 28 16:10:17 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:18 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-26e73c67-2cee-43e0-a6fa-d423d434d769" returned: 0 in 0.572s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-26e73c67-2cee-43e0-a6fa-d423d434d769 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:18 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-26e73c67-2cee-43e0-a6fa-d423d434d769 Sep 28 16:10:18 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:18 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-26e73c67-2cee-43e0-a6fa-d423d434d769" returned: 0 in 0.345s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] Lock "cinder-quobyte-26e73c67-2cee-43e0-a6fa-d423d434d769" released by "delete_volume" :: held 0.988s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:18 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] Created reservations ['eb081066-ec2d-4db4-bc52-d70b1178c848', 'e99f6790-2dde-464e-a972-dc9220b315c5', '94828e47-76d3-4c7e-ad7f-be7b5b297b78', 'd9456e8f-7072-43fb-839f-d6902bfa366a'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:19 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:10:19 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:19 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.357s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:19 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] Deleted volume successfully. Sep 28 16:10:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ca4d9695-af26-4834-8371-6d9cb09e9abd tempest-VolumesListTestJSON-938300630 None] Lock "cinder-26e73c67-2cee-43e0-a6fa-d423d434d769-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] Acquiring lock "cinder-f5aba2e0-52a1-4545-bfe3-7b1854383bd2-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] Lock "cinder-f5aba2e0-52a1-4545-bfe3-7b1854383bd2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] Acquiring lock "cinder-quobyte-f5aba2e0-52a1-4545-bfe3-7b1854383bd2" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] Lock "cinder-quobyte-f5aba2e0-52a1-4545-bfe3-7b1854383bd2" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] Acquiring lock "cinder-6768661a-8385-489b-9edf-d58c825e0fe4-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a5d12d-eba8-47b6-8c22-6c0a3093274c]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f5aba2e0-52a1-4545-bfe3-7b1854383bd2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] Lock "cinder-6768661a-8385-489b-9edf-d58c825e0fe4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] Acquiring lock "cinder-quobyte-6768661a-8385-489b-9edf-d58c825e0fe4" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] Lock "cinder-quobyte-6768661a-8385-489b-9edf-d58c825e0fe4" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cad778a-78e8-4589-b1a0-75febf8df047]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6768661a-8385-489b-9edf-d58c825e0fe4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:20 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f5aba2e0-52a1-4545-bfe3-7b1854383bd2 Sep 28 16:10:20 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:20 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6768661a-8385-489b-9edf-d58c825e0fe4 Sep 28 16:10:20 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:20 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f5aba2e0-52a1-4545-bfe3-7b1854383bd2" returned: 0 in 0.457s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f5aba2e0-52a1-4545-bfe3-7b1854383bd2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:20 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f5aba2e0-52a1-4545-bfe3-7b1854383bd2 Sep 28 16:10:20 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:20 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6768661a-8385-489b-9edf-d58c825e0fe4" returned: 0 in 0.453s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6768661a-8385-489b-9edf-d58c825e0fe4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:20 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6768661a-8385-489b-9edf-d58c825e0fe4 Sep 28 16:10:20 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:21 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f5aba2e0-52a1-4545-bfe3-7b1854383bd2" returned: 0 in 0.285s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] Lock "cinder-quobyte-f5aba2e0-52a1-4545-bfe3-7b1854383bd2" released by "delete_volume" :: held 0.807s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] Created reservations ['4bb960ce-b9b5-4ec2-be5b-420bb8264f92', '6effb9e3-7567-4bc1-9440-f3c1ab5af5d3', '60183442-2969-4f7e-a4fd-f2868eeef911', '67ecaa6e-515c-4056-abab-fa7e2624c370'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:21 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6768661a-8385-489b-9edf-d58c825e0fe4" returned: 0 in 0.275s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] Lock "cinder-quobyte-6768661a-8385-489b-9edf-d58c825e0fe4" released by "delete_volume" :: held 0.789s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] Created reservations ['26cc055d-f66c-4918-826c-c91d7e923343', '25ab8db0-fad7-4823-9bd7-0de46a664ab6', 'c3a02e5b-76ea-446b-b67c-bdf52c418068', '0dee5976-ec3a-4831-b519-924d11c3b85d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:21 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:10:21 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:21 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:10:21 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] Acquiring lock "cinder-a56e133e-a575-4ebb-8cc9-6967f7f56881-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] Acquiring lock "cinder-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] Lock "cinder-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] Lock "cinder-a56e133e-a575-4ebb-8cc9-6967f7f56881-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:21 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.422s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] Deleted volume successfully. Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2fe754fc-f778-448d-998c-6ddc54f8f65f tempest-AttachVolumeNegativeTest-429818067 None] Lock "cinder-f5aba2e0-52a1-4545-bfe3-7b1854383bd2-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] Acquiring lock "cinder-quobyte-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] Acquiring lock "cinder-quobyte-a56e133e-a575-4ebb-8cc9-6967f7f56881" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] Lock "cinder-quobyte-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd" acquired by "delete_volume" :: waited 0.036s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] Lock "cinder-quobyte-a56e133e-a575-4ebb-8cc9-6967f7f56881" acquired by "delete_volume" :: waited 0.053s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb72e98-d878-413c-8ff5-c0d83153dae7]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a757a4-c5b9-4ff0-9da8-513f22e70852]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a56e133e-a575-4ebb-8cc9-6967f7f56881 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:21 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.467s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] Deleted volume successfully. Sep 28 16:10:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-321dc106-9181-4926-9178-0cd5f6fda615 tempest-VolumesListTestJSON-938300630 None] Lock "cinder-6768661a-8385-489b-9edf-d58c825e0fe4-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:22 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd Sep 28 16:10:22 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:22 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a56e133e-a575-4ebb-8cc9-6967f7f56881 Sep 28 16:10:22 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:22 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd" returned: 0 in 0.459s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:22 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd Sep 28 16:10:22 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:22 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a56e133e-a575-4ebb-8cc9-6967f7f56881" returned: 0 in 0.511s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a56e133e-a575-4ebb-8cc9-6967f7f56881 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:22 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a56e133e-a575-4ebb-8cc9-6967f7f56881 Sep 28 16:10:22 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:22 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd" returned: 0 in 0.368s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:22 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] Lock "cinder-quobyte-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd" released by "delete_volume" :: held 0.898s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a56e133e-a575-4ebb-8cc9-6967f7f56881" returned: 0 in 0.323s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] Lock "cinder-quobyte-a56e133e-a575-4ebb-8cc9-6967f7f56881" released by "delete_volume" :: held 0.914s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:22 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] Created reservations ['8a5f30c6-6bca-448f-b88c-04b9be5f22cf', '3caba239-dea9-4894-98bb-59a4ea030ee9', 'b58cec96-8eaa-4120-98d1-c8b4d354650b', '241f3512-ff27-4d2d-a8a3-dfa44caf4fa0'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:22 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] Created reservations ['d2323f2d-2abd-46ec-bcdc-450f331bf864', 'a07421bc-122f-4b04-a59e-985bcea2d417', 'e6fb2055-1d7d-49f0-8d35-88fb9cc74212', '525add36-4848-43e7-a7b4-7c8be741d1d7'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:23 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:10:23 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:23 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:10:23 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:23 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.311s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:23 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:23 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] Deleted volume successfully. Sep 28 16:10:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-df369174-90c3-4f1f-a4a6-318c57965d49 tempest-VolumesListTestJSON-938300630 None] Lock "cinder-3e6175b6-ef2b-4d4f-b6c0-a7f030bb5ecd-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:23 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.307s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:23 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:23 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] Deleted volume successfully. Sep 28 16:10:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd84d519-1614-4d38-9d4e-c437326fde22 tempest-AttachVolumeNegativeTest-429818067 None] Lock "cinder-a56e133e-a575-4ebb-8cc9-6967f7f56881-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] Acquiring lock "cinder-208d81d7-3518-4d60-97f4-37616edbfc93-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] Lock "cinder-208d81d7-3518-4d60-97f4-37616edbfc93-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] Acquiring lock "cinder-quobyte-208d81d7-3518-4d60-97f4-37616edbfc93" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] Lock "cinder-quobyte-208d81d7-3518-4d60-97f4-37616edbfc93" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:24 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[240f4f2e-02de-49a6-bd65-85f587090740]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-208d81d7-3518-4d60-97f4-37616edbfc93 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:24 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-208d81d7-3518-4d60-97f4-37616edbfc93 Sep 28 16:10:24 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:24 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-208d81d7-3518-4d60-97f4-37616edbfc93" returned: 0 in 0.531s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-208d81d7-3518-4d60-97f4-37616edbfc93 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:24 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-208d81d7-3518-4d60-97f4-37616edbfc93 Sep 28 16:10:24 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:25 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-208d81d7-3518-4d60-97f4-37616edbfc93" returned: 0 in 0.324s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] Lock "cinder-quobyte-208d81d7-3518-4d60-97f4-37616edbfc93" released by "delete_volume" :: held 0.926s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:25 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] Created reservations ['1417a350-fe84-43bc-8fcd-c001131d9347', '2e78650d-8400-4649-a193-a8ad5b2c371b', '8d0fd087-eb36-4a9f-8a39-dd7506c6e0c6', 'e8b2d9a8-403d-4d6c-bade-e74979f80909'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:25 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:10:25 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:25 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.357s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:25 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:25 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] Deleted volume successfully. Sep 28 16:10:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e34cd80b-9e4f-4719-ac78-f9bf3d0f68de tempest-AttachVolumeNegativeTest-429818067 None] Lock "cinder-208d81d7-3518-4d60-97f4-37616edbfc93-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Flow 'volume_create_manager' (b43f9a55-74d2-44f2-8860-de189b83e288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571477e1-37f6-40cc-b23e-53abc155b054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571477e1-37f6-40cc-b23e-53abc155b054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1034279602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb93670b-d801-4f91-9672-1bf3b5821b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e2c2a53904413baf25b88ea0c66357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:34Z,use_quota=True,user_id='e4439d07edaa41afb3387c7770268c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d102d1-096e-4f02-b053-03e5c79db493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d102d1-096e-4f02-b053-03e5c79db493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba78ba2e-9744-468d-97c0-a5c45e9180b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba78ba2e-9744-468d-97c0-a5c45e9180b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb93670b-d801-4f91-9672-1bf3b5821b99', 'volume_name': 'volume-cb93670b-d801-4f91-9672-1bf3b5821b99', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb8dad9-16c7-4773-921c-8d933eaf45cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb8dad9-16c7-4773-921c-8d933eaf45cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c913a7e6-ba99-4aea-9b43-837b67f5bfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:34 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Volume cb93670b-d801-4f91-9672-1bf3b5821b99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb93670b-d801-4f91-9672-1bf3b5821b99', 'volume_size': 1} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1034279602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb93670b-d801-4f91-9672-1bf3b5821b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e2c2a53904413baf25b88ea0c66357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:34Z,use_quota=True,user_id='e4439d07edaa41afb3387c7770268c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Creating volume cb93670b-d801-4f91-9672-1bf3b5821b99 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:34 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb93670b-d801-4f91-9672-1bf3b5821b99 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:34 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb93670b-d801-4f91-9672-1bf3b5821b99 1073741824 Sep 28 16:10:34 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:34 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb93670b-d801-4f91-9672-1bf3b5821b99 1073741824" returned: 0 in 0.668s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb93670b-d801-4f91-9672-1bf3b5821b99 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:34 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb93670b-d801-4f91-9672-1bf3b5821b99 Sep 28 16:10:34 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:10:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:35 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:10:35 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:35 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb93670b-d801-4f91-9672-1bf3b5821b99" returned: 0 in 0.396s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:35 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.323s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c913a7e6-ba99-4aea-9b43-837b67f5bfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb93670b-d801-4f91-9672-1bf3b5821b99', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e99ace8-d5a6-4721-97c2-51b2d3c7cba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:10:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:10:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:10:35 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Volume volume-cb93670b-d801-4f91-9672-1bf3b5821b99 (cb93670b-d801-4f91-9672-1bf3b5821b99): created successfully Sep 28 16:10:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e99ace8-d5a6-4721-97c2-51b2d3c7cba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Flow 'volume_create_manager' (b43f9a55-74d2-44f2-8860-de189b83e288) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:35 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-df9b6ec8-7a6b-4dc4-8927-e82710e3f8d4 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Created volume successfully. Sep 28 16:10:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Acquiring lock "cinder-cb93670b-d801-4f91-9672-1bf3b5821b99-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Lock "cinder-cb93670b-d801-4f91-9672-1bf3b5821b99-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Acquiring lock "cinder-quobyte-cb93670b-d801-4f91-9672-1bf3b5821b99" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Lock "cinder-quobyte-cb93670b-d801-4f91-9672-1bf3b5821b99" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d0c9c6-5d0c-4c8d-aaf8-b235fc7e5eb2]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb93670b-d801-4f91-9672-1bf3b5821b99 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:37 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb93670b-d801-4f91-9672-1bf3b5821b99 Sep 28 16:10:37 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:38 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb93670b-d801-4f91-9672-1bf3b5821b99" returned: 0 in 0.530s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb93670b-d801-4f91-9672-1bf3b5821b99 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:38 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb93670b-d801-4f91-9672-1bf3b5821b99 Sep 28 16:10:38 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Flow 'volume_create_manager' (5f382765-8e77-4892-a545-4f7acae687e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d873b279-8c28-49c5-a421-6ee8b79d7d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d873b279-8c28-49c5-a421-6ee8b79d7d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1571559311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ed6fe1-2030-4b38-9045-70c37a1cb3e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b81ccd3c5cc4c56825ced5932d8ea65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:38Z,use_quota=True,user_id='c015f845684240baabb8d501e099a2f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3902b1-b3bb-4460-9747-546159931494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3902b1-b3bb-4460-9747-546159931494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b07b3a2-fb99-4860-ac63-02d5d69e345a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b07b3a2-fb99-4860-ac63-02d5d69e345a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3ed6fe1-2030-4b38-9045-70c37a1cb3e6', 'volume_name': 'volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d2fe24-3626-4a42-adf7-aa905c62ed9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d2fe24-3626-4a42-adf7-aa905c62ed9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9290279-4ae0-45ab-a3dc-a47daff578aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:38 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Volume a3ed6fe1-2030-4b38-9045-70c37a1cb3e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6', 'volume_size': 1} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1571559311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ed6fe1-2030-4b38-9045-70c37a1cb3e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b81ccd3c5cc4c56825ced5932d8ea65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:38Z,use_quota=True,user_id='c015f845684240baabb8d501e099a2f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Creating volume a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:38 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:38 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 1073741824 Sep 28 16:10:38 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:38 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cb93670b-d801-4f91-9672-1bf3b5821b99" returned: 0 in 0.364s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Lock "cinder-quobyte-cb93670b-d801-4f91-9672-1bf3b5821b99" released by "delete_volume" :: held 0.976s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Created reservations ['adc516b5-e3e0-4ab6-ada4-734f40fb8ed3', 'fe7f23f3-a444-429c-8f73-32dac3385084', 'fb3072c3-966c-4836-9eba-3905bf5c576b', 'c483c6f4-1818-41b9-ac06-f638707c14b2'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:39 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:10:39 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:39 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 1073741824" returned: 0 in 0.832s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:39 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.335s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:39 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Deleted volume successfully. Sep 28 16:10:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-26e04375-bf24-4f31-afc8-cf99a6d37e63 tempest-VolumeQuotasNegativeTestJSON-1692554463 None] Lock "cinder-cb93670b-d801-4f91-9672-1bf3b5821b99-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:39 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 Sep 28 16:10:39 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:39 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6" returned: 0 in 0.325s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9290279-4ae0-45ab-a3dc-a47daff578aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8e4664-4a5e-46c4-8d56-639be3b2ac1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:39 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Volume volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 (a3ed6fe1-2030-4b38-9045-70c37a1cb3e6): created successfully Sep 28 16:10:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8e4664-4a5e-46c4-8d56-639be3b2ac1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Flow 'volume_create_manager' (5f382765-8e77-4892-a545-4f7acae687e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-fe4089d3-2d00-47a7-881b-ec799b6c6c5a req-3fa594a3-22a4-4e44-97b1-01801cc494dd tempest-VolumesSnapshotsTestJSON-1134695984 None] Created volume successfully. Sep 28 16:10:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-06ef74c3-2836-42a5-8985-5213b8b7a980 req-d8861e7a-7268-4ab3-b082-60e030ef6a59 tempest-VolumesSnapshotsTestJSON-1134695984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-06ef74c3-2836-42a5-8985-5213b8b7a980 req-d8861e7a-7268-4ab3-b082-60e030ef6a59 tempest-VolumesSnapshotsTestJSON-1134695984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [req-06ef74c3-2836-42a5-8985-5213b8b7a980 req-d8861e7a-7268-4ab3-b082-60e030ef6a59 tempest-VolumesSnapshotsTestJSON-1134695984 None] Creating offline snapshot b9346aa4-1e53-45e4-88d4-f1f79308dbe3 of volume a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:10:41 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ad7004-e699-42ea-84fd-70d7782402bb]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-06ef74c3-2836-42a5-8985-5213b8b7a980 req-d8861e7a-7268-4ab3-b082-60e030ef6a59 tempest-VolumesSnapshotsTestJSON-1134695984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:41 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 Sep 28 16:10:41 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:41 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-06ef74c3-2836-42a5-8985-5213b8b7a980 req-d8861e7a-7268-4ab3-b082-60e030ef6a59 tempest-VolumesSnapshotsTestJSON-1134695984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6" returned: 0 in 0.586s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-06ef74c3-2836-42a5-8985-5213b8b7a980 req-d8861e7a-7268-4ab3-b082-60e030ef6a59 tempest-VolumesSnapshotsTestJSON-1134695984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:41 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3 1G Sep 28 16:10:41 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:42 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-06ef74c3-2836-42a5-8985-5213b8b7a980 req-d8861e7a-7268-4ab3-b082-60e030ef6a59 tempest-VolumesSnapshotsTestJSON-1134695984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3 1G" returned: 0 in 0.588s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-06ef74c3-2836-42a5-8985-5213b8b7a980 req-d8861e7a-7268-4ab3-b082-60e030ef6a59 tempest-VolumesSnapshotsTestJSON-1134695984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:42 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3 Sep 28 16:10:42 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:42 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-06ef74c3-2836-42a5-8985-5213b8b7a980 req-d8861e7a-7268-4ab3-b082-60e030ef6a59 tempest-VolumesSnapshotsTestJSON-1134695984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3" returned: 0 in 0.424s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:42 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [req-06ef74c3-2836-42a5-8985-5213b8b7a980 req-d8861e7a-7268-4ab3-b082-60e030ef6a59 tempest-VolumesSnapshotsTestJSON-1134695984 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3 is being set with open permissions: ugo+rw Sep 28 16:10:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-06ef74c3-2836-42a5-8985-5213b8b7a980 req-d8861e7a-7268-4ab3-b082-60e030ef6a59 tempest-VolumesSnapshotsTestJSON-1134695984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:42 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3 Sep 28 16:10:42 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:42 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-06ef74c3-2836-42a5-8985-5213b8b7a980 req-d8861e7a-7268-4ab3-b082-60e030ef6a59 tempest-VolumesSnapshotsTestJSON-1134695984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3" returned: 0 in 0.335s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-06ef74c3-2836-42a5-8985-5213b8b7a980 req-d8861e7a-7268-4ab3-b082-60e030ef6a59 tempest-VolumesSnapshotsTestJSON-1134695984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:43 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.info Sep 28 16:10:43 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:43 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-06ef74c3-2836-42a5-8985-5213b8b7a980 req-d8861e7a-7268-4ab3-b082-60e030ef6a59 tempest-VolumesSnapshotsTestJSON-1134695984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.info" returned: 0 in 0.433s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:43 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [req-06ef74c3-2836-42a5-8985-5213b8b7a980 req-d8861e7a-7268-4ab3-b082-60e030ef6a59 tempest-VolumesSnapshotsTestJSON-1134695984 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.info is being set with open permissions: ugo+rw Sep 28 16:10:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-06ef74c3-2836-42a5-8985-5213b8b7a980 req-d8861e7a-7268-4ab3-b082-60e030ef6a59 tempest-VolumesSnapshotsTestJSON-1134695984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:43 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.info Sep 28 16:10:43 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:43 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-06ef74c3-2836-42a5-8985-5213b8b7a980 req-d8861e7a-7268-4ab3-b082-60e030ef6a59 tempest-VolumesSnapshotsTestJSON-1134695984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.info" returned: 0 in 0.350s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-06ef74c3-2836-42a5-8985-5213b8b7a980 req-d8861e7a-7268-4ab3-b082-60e030ef6a59 tempest-VolumesSnapshotsTestJSON-1134695984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.868s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:43 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=121,cinder:INSERT=38,cinder:UPDATE=152,cinder:DELETE=8 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:10:43 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-06ef74c3-2836-42a5-8985-5213b8b7a980 req-d8861e7a-7268-4ab3-b082-60e030ef6a59 tempest-VolumesSnapshotsTestJSON-1134695984 None] Create snapshot completed successfully Sep 28 16:10:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] Acquiring lock "cinder-b9346aa4-1e53-45e4-88d4-f1f79308dbe3-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] Lock "cinder-b9346aa4-1e53-45e4-88d4-f1f79308dbe3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] Acquiring lock "cinder-quobyte-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] Lock "cinder-quobyte-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] Acquiring lock "cinder-quobyte-b9346aa4-1e53-45e4-88d4-f1f79308dbe3" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] Lock "cinder-quobyte-b9346aa4-1e53-45e4-88d4-f1f79308dbe3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] Deleting offline snapshot b9346aa4-1e53-45e4-88d4-f1f79308dbe3 of volume a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:10:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] snapshot_file for this snap is: volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:10:45 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3fc790-c5b8-4ad4-9406-8d3bab70b22c]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:45 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3 Sep 28 16:10:45 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:45 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3" returned: 0 in 0.459s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:10:45 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12b868a-5338-4058-9502-32c69d40d4b5]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:45 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 Sep 28 16:10:45 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Flow 'volume_create_manager' (868fb245-9d7e-4511-9529-ff4d96665738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e328eb50-e44b-4ecb-9a51-17b7ac94c4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e328eb50-e44b-4ecb-9a51-17b7ac94c4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-654156152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127523ee-ff09-4dbf-83e2-3fd0b4391f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c897809efa5475eb9f7b333f207dd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:46Z,use_quota=True,user_id='652d3e75f4ac4baab0b2057533c79e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57578f35-5119-49e0-9c5e-32fefcc8ae6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57578f35-5119-49e0-9c5e-32fefcc8ae6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3078eb01-d161-4ad8-9667-1d1662e92fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3078eb01-d161-4ad8-9667-1d1662e92fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '127523ee-ff09-4dbf-83e2-3fd0b4391f51', 'volume_name': 'volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e42f1c9-5bc5-4d29-b6fc-e7b6108d3b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e42f1c9-5bc5-4d29-b6fc-e7b6108d3b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb47188-e342-40cb-88c4-2ab90c63f9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:46 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Volume 127523ee-ff09-4dbf-83e2-3fd0b4391f51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51', 'volume_size': 1} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-654156152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127523ee-ff09-4dbf-83e2-3fd0b4391f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c897809efa5475eb9f7b333f207dd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:46Z,use_quota=True,user_id='652d3e75f4ac4baab0b2057533c79e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Creating volume 127523ee-ff09-4dbf-83e2-3fd0b4391f51 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:46 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:46 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6" returned: 0 in 0.566s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:46 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51 1073741824 Sep 28 16:10:46 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:46 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3 Sep 28 16:10:46 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:46 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3" returned: 0 in 0.439s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:46 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3 Sep 28 16:10:46 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:46 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51 1073741824" returned: 0 in 0.502s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:46 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51 Sep 28 16:10:46 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:46 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6.b9346aa4-1e53-45e4-88d4-f1f79308dbe3" returned: 0 in 0.309s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] Lock "cinder-quobyte-b9346aa4-1e53-45e4-88d4-f1f79308dbe3" released by "_delete_snapshot" :: held 1.950s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] Lock "cinder-quobyte-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6" released by "delete_snapshot" :: held 1.981s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:47 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51" returned: 0 in 0.329s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb47188-e342-40cb-88c4-2ab90c63f9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6fe9a3-b4d6-446f-86b5-e63cd053c7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:47 devstack cinder-volume[87087]: DEBUG cinder.quota [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] Created reservations ['d3cc2018-cb3f-45e3-84cf-db6774aaa00d', '0a7a50d9-e310-4a06-9f7e-e41fff00fe52', 'db21c17f-8042-4acb-a20b-9caefa830805', '5494805f-6fcf-4acc-8077-3d439003d87f'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:47 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Volume volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51 (127523ee-ff09-4dbf-83e2-3fd0b4391f51): created successfully Sep 28 16:10:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6fe9a3-b4d6-446f-86b5-e63cd053c7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Flow 'volume_create_manager' (868fb245-9d7e-4511-9529-ff4d96665738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-fb225b0c-928d-4857-a33c-ddb71a2428f7 tempest-VolumesSnapshotTestJSON-1935054028 None] Created volume successfully. Sep 28 16:10:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] Delete snapshot completed successfully. Sep 28 16:10:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-fa5ad465-e4dc-41d6-ac14-2f71828078be req-fbdf540c-a58a-47d7-84c1-b209f2386073 tempest-VolumesSnapshotsTestJSON-1134695984 None] Lock "cinder-b9346aa4-1e53-45e4-88d4-f1f79308dbe3-delete_snapshot" released by "delete_snapshot" :: held 2.230s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] Acquiring lock "cinder-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] Lock "cinder-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] Acquiring lock "cinder-quobyte-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] Lock "cinder-quobyte-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:47 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30f4e0e-c3da-4629-9715-6a64b88bed0d]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:47 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 Sep 28 16:10:47 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:47 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6" returned: 0 in 0.389s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:47 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6 Sep 28 16:10:47 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:48 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6" returned: 0 in 0.301s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] Lock "cinder-quobyte-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6" released by "delete_volume" :: held 0.786s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.quota [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] Created reservations ['d6f1e127-d820-4bd8-9d21-e92e629646f0', 'a109d278-0ea0-4209-bb9c-1ed7055303c3', '10074e0e-76c1-4609-9301-1dc0d0cb6c17', '84cffea2-89e9-434e-ad6f-56b98ab6d095'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:48 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:10:48 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Flow 'volume_create_manager' (dec8da6d-11be-4c4a-9d98-8c8f29c7fa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f28acbf-0c7f-4c48-a670-51dc4cf66f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f28acbf-0c7f-4c48-a670-51dc4cf66f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1708753073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e993130-edcc-499d-8f2a-7dd193143ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9205d86e5e804642b998f2adf7ad4d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:48Z,use_quota=True,user_id='e7eabfacf39e4cec90abde033c9be6c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cadf06ba-2334-48d9-91d2-7468abb2c817),volume_type_id=cadf06ba-2334-48d9-91d2-7468abb2c817)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65016784-8f91-46b2-bfee-fe39258e0ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65016784-8f91-46b2-bfee-fe39258e0ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (facdb6f9-1449-43f1-87ac-715a1e870fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (facdb6f9-1449-43f1-87ac-715a1e870fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e993130-edcc-499d-8f2a-7dd193143ffe', 'volume_name': 'volume-7e993130-edcc-499d-8f2a-7dd193143ffe', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8893b39e-5a7c-4b37-8901-80b151efa986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8893b39e-5a7c-4b37-8901-80b151efa986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e16e6e7-0ea2-4765-9123-22d7f9dd7d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:48 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Volume 7e993130-edcc-499d-8f2a-7dd193143ffe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e993130-edcc-499d-8f2a-7dd193143ffe', 'volume_size': 1} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1708753073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e993130-edcc-499d-8f2a-7dd193143ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9205d86e5e804642b998f2adf7ad4d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:48Z,use_quota=True,user_id='e7eabfacf39e4cec90abde033c9be6c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cadf06ba-2334-48d9-91d2-7468abb2c817),volume_type_id=cadf06ba-2334-48d9-91d2-7468abb2c817)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Creating volume 7e993130-edcc-499d-8f2a-7dd193143ffe {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:48 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e993130-edcc-499d-8f2a-7dd193143ffe 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:48 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e993130-edcc-499d-8f2a-7dd193143ffe 1073741824 Sep 28 16:10:48 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8e70c812-c4fa-489a-aeb5-fce33acf8948 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:48 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.421s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.manager [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:48 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] Deleted volume successfully. Sep 28 16:10:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-14d0f4cf-b822-46ad-bfd1-0e1ac5a94335 req-348e155a-8e90-4390-bea7-a662372622d5 tempest-VolumesSnapshotsTestJSON-1134695984 None] Lock "cinder-a3ed6fe1-2030-4b38-9045-70c37a1cb3e6-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:49 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e993130-edcc-499d-8f2a-7dd193143ffe 1073741824" returned: 0 in 0.524s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e993130-edcc-499d-8f2a-7dd193143ffe {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:49 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e993130-edcc-499d-8f2a-7dd193143ffe Sep 28 16:10:49 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:49 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e993130-edcc-499d-8f2a-7dd193143ffe" returned: 0 in 0.295s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8e70c812-c4fa-489a-aeb5-fce33acf8948 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.825s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8e70c812-c4fa-489a-aeb5-fce33acf8948 tempest-VolumesSnapshotTestJSON-1935054028 None] Creating offline snapshot b6b1680d-741d-4ca2-8059-2c9fa1f112bc of volume 127523ee-ff09-4dbf-83e2-3fd0b4391f51 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:10:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e16e6e7-0ea2-4765-9123-22d7f9dd7d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e993130-edcc-499d-8f2a-7dd193143ffe', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3234657d-167c-40a0-8910-518813f99e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:49 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39cd59b-5c37-4525-be12-4120181afd4c]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8e70c812-c4fa-489a-aeb5-fce33acf8948 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:49 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Volume volume-7e993130-edcc-499d-8f2a-7dd193143ffe (7e993130-edcc-499d-8f2a-7dd193143ffe): created successfully Sep 28 16:10:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3234657d-167c-40a0-8910-518813f99e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Flow 'volume_create_manager' (dec8da6d-11be-4c4a-9d98-8c8f29c7fa20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5b665973-27a2-4771-b397-6f89b7010b18 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Created volume successfully. Sep 28 16:10:49 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51 Sep 28 16:10:49 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:50 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8e70c812-c4fa-489a-aeb5-fce33acf8948 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51" returned: 0 in 0.494s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8e70c812-c4fa-489a-aeb5-fce33acf8948 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:50 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc 1G Sep 28 16:10:50 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:50 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8e70c812-c4fa-489a-aeb5-fce33acf8948 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc 1G" returned: 0 in 0.640s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8e70c812-c4fa-489a-aeb5-fce33acf8948 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:50 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc Sep 28 16:10:50 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:51 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8e70c812-c4fa-489a-aeb5-fce33acf8948 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc" returned: 0 in 0.459s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:51 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-8e70c812-c4fa-489a-aeb5-fce33acf8948 tempest-VolumesSnapshotTestJSON-1935054028 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc is being set with open permissions: ugo+rw Sep 28 16:10:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8e70c812-c4fa-489a-aeb5-fce33acf8948 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:51 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc Sep 28 16:10:51 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-006564f6-b5b5-48a2-8c8b-efe3f200575e tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-006564f6-b5b5-48a2-8c8b-efe3f200575e tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-006564f6-b5b5-48a2-8c8b-efe3f200575e tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-006564f6-b5b5-48a2-8c8b-efe3f200575e tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-006564f6-b5b5-48a2-8c8b-efe3f200575e tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-006564f6-b5b5-48a2-8c8b-efe3f200575e tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:51 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:10:51 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:51 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8e70c812-c4fa-489a-aeb5-fce33acf8948 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc" returned: 0 in 0.296s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8e70c812-c4fa-489a-aeb5-fce33acf8948 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:51 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.info Sep 28 16:10:51 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:51 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-006564f6-b5b5-48a2-8c8b-efe3f200575e tempest-VolumeRetypeWithoutMigrationTest-768715321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.398s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:51 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-006564f6-b5b5-48a2-8c8b-efe3f200575e tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:51 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-006564f6-b5b5-48a2-8c8b-efe3f200575e tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Retype volume completed successfully. Sep 28 16:10:51 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8e70c812-c4fa-489a-aeb5-fce33acf8948 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.info" returned: 0 in 0.351s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:51 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-8e70c812-c4fa-489a-aeb5-fce33acf8948 tempest-VolumesSnapshotTestJSON-1935054028 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.info is being set with open permissions: ugo+rw Sep 28 16:10:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8e70c812-c4fa-489a-aeb5-fce33acf8948 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:51 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.info Sep 28 16:10:51 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:52 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8e70c812-c4fa-489a-aeb5-fce33acf8948 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.info" returned: 0 in 0.285s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8e70c812-c4fa-489a-aeb5-fce33acf8948 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.660s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:52 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8e70c812-c4fa-489a-aeb5-fce33acf8948 tempest-VolumesSnapshotTestJSON-1935054028 None] Create snapshot completed successfully Sep 28 16:10:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Acquiring lock "cinder-7e993130-edcc-499d-8f2a-7dd193143ffe-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Lock "cinder-7e993130-edcc-499d-8f2a-7dd193143ffe-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Acquiring lock "cinder-quobyte-7e993130-edcc-499d-8f2a-7dd193143ffe" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Lock "cinder-quobyte-7e993130-edcc-499d-8f2a-7dd193143ffe" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:52 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c696c9d9-17bb-4a2f-9581-a707481fb812]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e993130-edcc-499d-8f2a-7dd193143ffe {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:52 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e993130-edcc-499d-8f2a-7dd193143ffe Sep 28 16:10:52 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-b6b1680d-741d-4ca2-8059-2c9fa1f112bc-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-b6b1680d-741d-4ca2-8059-2c9fa1f112bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-quobyte-127523ee-ff09-4dbf-83e2-3fd0b4391f51" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-127523ee-ff09-4dbf-83e2-3fd0b4391f51" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-quobyte-b6b1680d-741d-4ca2-8059-2c9fa1f112bc" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-b6b1680d-741d-4ca2-8059-2c9fa1f112bc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] Deleting offline snapshot b6b1680d-741d-4ca2-8059-2c9fa1f112bc of volume 127523ee-ff09-4dbf-83e2-3fd0b4391f51 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:10:53 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] snapshot_file for this snap is: volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e993130-edcc-499d-8f2a-7dd193143ffe" returned: 0 in 0.526s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e993130-edcc-499d-8f2a-7dd193143ffe {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68be992-6c82-4d7d-9b6e-0e6a15f71834]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:53 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e993130-edcc-499d-8f2a-7dd193143ffe Sep 28 16:10:53 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:53 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc Sep 28 16:10:53 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:53 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e993130-edcc-499d-8f2a-7dd193143ffe" returned: 0 in 0.320s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Lock "cinder-quobyte-7e993130-edcc-499d-8f2a-7dd193143ffe" released by "delete_volume" :: held 0.902s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:53 devstack cinder-volume[87087]: WARNING cinder.quota [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:10:53 devstack cinder-volume[87087]: WARNING cinder.quota [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Created reservations ['5e85d610-7892-4d44-b32c-2cb832152944', '3371ceed-3191-4a87-a968-62fe8a07d093', '3ddc42c8-3bee-459e-83b8-5cf5a3475d75', 'bde760d2-df2c-4ea3-abed-aefd2a15373a'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:53 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc" returned: 0 in 0.457s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[330feaa6-1174-4bf8-bc03-2ce98077c14e]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:53 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:10:53 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:53 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51 Sep 28 16:10:53 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cbc34b12-39b1-4d40-8ee7-85fafc222813 tempest-BackendsCapabilitiesAdminTestsJSON-2107895492 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1790084838867, 'free_capacity_gb': 1775.1790084838867, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87087) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 16:10:54 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.331s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:54 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ad4dea6e-03ad-4ffe-a053-99ca31e6ec33 tempest-BackendsCapabilitiesAdminTestsJSON-2107895492 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1790084838867, 'free_capacity_gb': 1775.1790084838867, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87087) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 16:10:54 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Deleted volume successfully. Sep 28 16:10:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b28b8ff0-2812-4533-ab5b-7b880e5f8058 tempest-VolumeRetypeWithoutMigrationTest-768715321 None] Lock "cinder-7e993130-edcc-499d-8f2a-7dd193143ffe-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:54 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51" returned: 0 in 0.513s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:54 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc Sep 28 16:10:54 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:54 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc" returned: 0 in 0.458s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:54 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc Sep 28 16:10:54 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:55 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51.b6b1680d-741d-4ca2-8059-2c9fa1f112bc" returned: 0 in 0.309s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-b6b1680d-741d-4ca2-8059-2c9fa1f112bc" released by "_delete_snapshot" :: held 1.919s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-127523ee-ff09-4dbf-83e2-3fd0b4391f51" released by "delete_snapshot" :: held 1.947s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:55 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] Created reservations ['f987bea3-56da-4462-9f04-eb32c0707916', '8ac68662-a395-4146-915e-2c6560a5c9a8', 'f3e1efe7-4f31-4b69-b84b-022aa65cbedb', '1ef48982-cf90-4e61-8843-d4cbff55295b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:55 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] Delete snapshot completed successfully. Sep 28 16:10:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-338d4d40-894c-42ee-bc38-fde7dba2b669 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-b6b1680d-741d-4ca2-8059-2c9fa1f112bc-delete_snapshot" released by "delete_snapshot" :: held 2.185s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Flow 'volume_create_manager' (9bc729cd-ef5a-4771-8391-070ff5762050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ee1bd7-ad5a-484c-b8bb-a8ab7ad90cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ee1bd7-ad5a-484c-b8bb-a8ab7ad90cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-839335482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cfa236-e324-40c6-bc3e-b279bb920ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c897809efa5475eb9f7b333f207dd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:57Z,use_quota=True,user_id='652d3e75f4ac4baab0b2057533c79e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa997fa-cc3c-406a-b003-a577f87a5661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa997fa-cc3c-406a-b003-a577f87a5661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d22e106-8a54-4b16-af70-2dd245a67cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d22e106-8a54-4b16-af70-2dd245a67cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55cfa236-e324-40c6-bc3e-b279bb920ec3', 'volume_name': 'volume-55cfa236-e324-40c6-bc3e-b279bb920ec3', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894c2468-9268-4165-adf7-a9c42df9cad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894c2468-9268-4165-adf7-a9c42df9cad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74805d1-69a1-470d-a66a-34d560693f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:57 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Volume 55cfa236-e324-40c6-bc3e-b279bb920ec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55cfa236-e324-40c6-bc3e-b279bb920ec3', 'volume_size': 1} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-839335482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cfa236-e324-40c6-bc3e-b279bb920ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c897809efa5475eb9f7b333f207dd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:57Z,use_quota=True,user_id='652d3e75f4ac4baab0b2057533c79e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Creating volume 55cfa236-e324-40c6-bc3e-b279bb920ec3 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:57 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:10:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:57 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 1073741824 Sep 28 16:10:57 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:58 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 1073741824" returned: 0 in 0.719s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:58 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 Sep 28 16:10:58 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:58 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3" returned: 0 in 0.296s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74805d1-69a1-470d-a66a-34d560693f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55cfa236-e324-40c6-bc3e-b279bb920ec3', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94c0124-3e86-41a5-987c-1fa58a5bdedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:58 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Volume volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 (55cfa236-e324-40c6-bc3e-b279bb920ec3): created successfully Sep 28 16:10:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94c0124-3e86-41a5-987c-1fa58a5bdedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Flow 'volume_create_manager' (9bc729cd-ef5a-4771-8391-070ff5762050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-fa76202e-fd4c-4fbd-abdc-cae7003dd7d2 tempest-VolumesSnapshotTestJSON-1935054028 None] Created volume successfully. Sep 28 16:10:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3e9d2ddb-eb40-46d8-ae55-33f19353a403 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3e9d2ddb-eb40-46d8-ae55-33f19353a403 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3e9d2ddb-eb40-46d8-ae55-33f19353a403 tempest-VolumesSnapshotTestJSON-1935054028 None] Creating offline snapshot 11064b19-548d-47ca-8de5-f03f9c7cf021 of volume 55cfa236-e324-40c6-bc3e-b279bb920ec3 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:10:59 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91ef4c2-83fb-4441-a44d-9afd19f04372]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e9d2ddb-eb40-46d8-ae55-33f19353a403 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:59 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 Sep 28 16:10:59 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:59 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e9d2ddb-eb40-46d8-ae55-33f19353a403 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3" returned: 0 in 0.510s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e9d2ddb-eb40-46d8-ae55-33f19353a403 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:00 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021 1G Sep 28 16:11:00 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:00 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e9d2ddb-eb40-46d8-ae55-33f19353a403 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021 1G" returned: 0 in 0.589s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e9d2ddb-eb40-46d8-ae55-33f19353a403 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:00 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021 Sep 28 16:11:00 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:01 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e9d2ddb-eb40-46d8-ae55-33f19353a403 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021" returned: 0 in 0.455s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:01 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-3e9d2ddb-eb40-46d8-ae55-33f19353a403 tempest-VolumesSnapshotTestJSON-1935054028 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021 is being set with open permissions: ugo+rw Sep 28 16:11:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e9d2ddb-eb40-46d8-ae55-33f19353a403 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:01 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021 Sep 28 16:11:01 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:01 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e9d2ddb-eb40-46d8-ae55-33f19353a403 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021" returned: 0 in 0.372s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e9d2ddb-eb40-46d8-ae55-33f19353a403 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:01 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.info Sep 28 16:11:01 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:01 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e9d2ddb-eb40-46d8-ae55-33f19353a403 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.info" returned: 0 in 0.364s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:01 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-3e9d2ddb-eb40-46d8-ae55-33f19353a403 tempest-VolumesSnapshotTestJSON-1935054028 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.info is being set with open permissions: ugo+rw Sep 28 16:11:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e9d2ddb-eb40-46d8-ae55-33f19353a403 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:01 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.info Sep 28 16:11:01 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:02 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e9d2ddb-eb40-46d8-ae55-33f19353a403 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.info" returned: 0 in 0.323s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3e9d2ddb-eb40-46d8-ae55-33f19353a403 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.765s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:02 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1d099e55-01fc-4784-8537-1a3b3df272f5 tempest-GroupsTest-481770278 None] Group tempest-Group1-1434109955: creating Sep 28 16:11:02 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3e9d2ddb-eb40-46d8-ae55-33f19353a403 tempest-VolumesSnapshotTestJSON-1935054028 None] Create snapshot completed successfully Sep 28 16:11:02 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1d099e55-01fc-4784-8537-1a3b3df272f5 tempest-GroupsTest-481770278 None] Group tempest-Group1-1434109955: created successfully Sep 28 16:11:02 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1d099e55-01fc-4784-8537-1a3b3df272f5 tempest-GroupsTest-481770278 None] Create group completed successfully. Sep 28 16:11:02 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:11:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Flow 'volume_create_manager' (9eb29742-6369-4906-842b-cdfab5fc6d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912486c0-b5b6-4dfd-9b59-78bee9e66d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912486c0-b5b6-4dfd-9b59-78bee9e66d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1826288343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6d8a389-c5b7-4c0a-8160-cac9e7696182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093cde35e03f4a4682737c1d55afe70c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:03Z,use_quota=True,user_id='760f15d6cab444dea267eb1054d10677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9014cc-2783-4d56-bc45-bde143e1618b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9014cc-2783-4d56-bc45-bde143e1618b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd62044c-0908-464f-9329-dd0794b5a968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd62044c-0908-464f-9329-dd0794b5a968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6d8a389-c5b7-4c0a-8160-cac9e7696182', 'volume_name': 'volume-d6d8a389-c5b7-4c0a-8160-cac9e7696182', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec188aec-4f6f-47ce-86dc-2460fb382437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec188aec-4f6f-47ce-86dc-2460fb382437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5164346f-70c0-4c32-85af-188f971f56a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:03 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Volume d6d8a389-c5b7-4c0a-8160-cac9e7696182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6d8a389-c5b7-4c0a-8160-cac9e7696182', 'volume_size': 1} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1826288343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6d8a389-c5b7-4c0a-8160-cac9e7696182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093cde35e03f4a4682737c1d55afe70c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:03Z,use_quota=True,user_id='760f15d6cab444dea267eb1054d10677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Creating volume d6d8a389-c5b7-4c0a-8160-cac9e7696182 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:11:03 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6d8a389-c5b7-4c0a-8160-cac9e7696182 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:03 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6d8a389-c5b7-4c0a-8160-cac9e7696182 1073741824 Sep 28 16:11:03 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Flow 'volume_create_manager' (8d13f0ab-ac28-4e32-9423-ca6e14375dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a143d1-d348-4520-ac61-4423393915ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a143d1-d348-4520-ac61-4423393915ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1069996535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b99fa33-0585-4f76-9dcf-03ea739af0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c897809efa5475eb9f7b333f207dd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=11064b19-548d-47ca-8de5-f03f9c7cf021,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:03Z,use_quota=True,user_id='652d3e75f4ac4baab0b2057533c79e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d0607a-9e7c-47eb-bfde-1abbc06ab2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d0607a-9e7c-47eb-bfde-1abbc06ab2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee170336-3733-41a8-b56b-57117dfb4924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee170336-3733-41a8-b56b-57117dfb4924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7b99fa33-0585-4f76-9dcf-03ea739af0bf', 'volume_name': 'volume-7b99fa33-0585-4f76-9dcf-03ea739af0bf', 'volume_size': 2, 'snapshot_id': '11064b19-548d-47ca-8de5-f03f9c7cf021'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e61178d-1e76-4df1-8f89-a0d0ce61f0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e61178d-1e76-4df1-8f89-a0d0ce61f0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633b5db9-8a53-4e78-b5a7-34edb13bc41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:03 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Volume 7b99fa33-0585-4f76-9dcf-03ea739af0bf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7b99fa33-0585-4f76-9dcf-03ea739af0bf', 'volume_size': 2, 'snapshot_id': '11064b19-548d-47ca-8de5-f03f9c7cf021'} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-51df0007-aab9-4fb8-9b0f-077e4e71dd44 tempest-GroupsTest-481770278 None] Group tempest-Group2-786030034: creating Sep 28 16:11:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-51df0007-aab9-4fb8-9b0f-077e4e71dd44 tempest-GroupsTest-481770278 None] Group tempest-Group2-786030034: created successfully Sep 28 16:11:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-51df0007-aab9-4fb8-9b0f-077e4e71dd44 tempest-GroupsTest-481770278 None] Create group completed successfully. Sep 28 16:11:03 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6d8a389-c5b7-4c0a-8160-cac9e7696182 1073741824" returned: 0 in 0.608s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6d8a389-c5b7-4c0a-8160-cac9e7696182 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:03 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6d8a389-c5b7-4c0a-8160-cac9e7696182 Sep 28 16:11:03 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:03 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6d8a389-c5b7-4c0a-8160-cac9e7696182" returned: 0 in 0.266s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.479s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-quobyte-11064b19-548d-47ca-8de5-f03f9c7cf021-7b99fa33-0585-4f76-9dcf-03ea739af0bf" by "_create_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5164346f-70c0-4c32-85af-188f971f56a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6d8a389-c5b7-4c0a-8160-cac9e7696182', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22c469f-d648-47a9-95b7-8008987972c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-11064b19-548d-47ca-8de5-f03f9c7cf021-7b99fa33-0585-4f76-9dcf-03ea739af0bf" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Creating volume 7b99fa33-0585-4f76-9dcf-03ea739af0bf from snapshot 11064b19-548d-47ca-8de5-f03f9c7cf021 {{(pid=87087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-quobyte-7b99fa33-0585-4f76-9dcf-03ea739af0bf" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:04 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Volume volume-d6d8a389-c5b7-4c0a-8160-cac9e7696182 (d6d8a389-c5b7-4c0a-8160-cac9e7696182): created successfully Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22c469f-d648-47a9-95b7-8008987972c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Flow 'volume_create_manager' (9eb29742-6369-4906-842b-cdfab5fc6d9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-7b99fa33-0585-4f76-9dcf-03ea739af0bf" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] snapshot: 11064b19-548d-47ca-8de5-f03f9c7cf021, volume: 7b99fa33-0585-4f76-9dcf-03ea739af0bf, {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:04 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-16b1b893-3598-484c-b3b6-0685b8499f77 tempest-VolumesServicesTestJSON-1560451529 None] Created volume successfully. Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2058e7-ec65-4542-a447-993ff6f012ac]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:04 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021 Sep 28 16:11:04 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:04 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021" returned: 0 in 0.436s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55cfa236-e324-40c6-bc3e-b279bb920ec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7c30a6-3bac-4340-a75e-98cf192c62ae]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:04 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 Sep 28 16:11:04 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:05 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3" returned: 0 in 0.426s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Path /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b99fa33-0585-4f76-9dcf-03ea739af0bf not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b99fa33-0585-4f76-9dcf-03ea739af0bf {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:05 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b99fa33-0585-4f76-9dcf-03ea739af0bf Sep 28 16:11:05 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] Acquiring lock "cinder-d6d8a389-c5b7-4c0a-8160-cac9e7696182-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] Lock "cinder-d6d8a389-c5b7-4c0a-8160-cac9e7696182-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] Acquiring lock "cinder-quobyte-d6d8a389-c5b7-4c0a-8160-cac9e7696182" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] Lock "cinder-quobyte-d6d8a389-c5b7-4c0a-8160-cac9e7696182" acquired by "delete_volume" :: waited 0.036s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc01c97-afad-4505-9dac-63c8d7cc7629]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6d8a389-c5b7-4c0a-8160-cac9e7696182 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Flow 'volume_create_manager' (160ed2a1-1f45-4944-a50e-9df15a085032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d15203-9704-47a5-a6c5-870f594fecae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d15203-9704-47a5-a6c5-870f594fecae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2082003996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84bc0e72-2b88-42de-86ab-2db609cb1037,host='devstack@QuobyteHD#QuobyteHD',id=4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5990d7250b2344789366347a646ea103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:05Z,use_quota=True,user_id='ad889429d28a4a5285063bb0f3350366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fbb6cb6-5fa3-4be8-94fb-2b3487a02bac),volume_type_id=0fbb6cb6-5fa3-4be8-94fb-2b3487a02bac)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59b3457-d6fb-4cb3-bdb2-fa8b0c6c24a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59b3457-d6fb-4cb3-bdb2-fa8b0c6c24a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b56222-7d7a-4021-b5f5-b1063c4dc6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b56222-7d7a-4021-b5f5-b1063c4dc6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e', 'volume_name': 'volume-4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdab196-dcf7-4b70-94de-46fad642471c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:05 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6d8a389-c5b7-4c0a-8160-cac9e7696182 Sep 28 16:11:05 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdab196-dcf7-4b70-94de-46fad642471c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07233a1e-6c6d-41b3-ba02-cf72b1cf449f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:05 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Volume 4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e', 'volume_size': 1} Sep 28 16:11:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:06 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6d8a389-c5b7-4c0a-8160-cac9e7696182" returned: 0 in 0.514s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6d8a389-c5b7-4c0a-8160-cac9e7696182 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:06 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6d8a389-c5b7-4c0a-8160-cac9e7696182 Sep 28 16:11:06 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:06 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d6d8a389-c5b7-4c0a-8160-cac9e7696182" returned: 0 in 0.383s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] Lock "cinder-quobyte-d6d8a389-c5b7-4c0a-8160-cac9e7696182" released by "delete_volume" :: held 0.985s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:06 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] Created reservations ['ef2e51fd-1af5-4839-9da9-de7a5e28ae7a', 'c09366bf-6837-4dbd-84a0-0f8bf6f3691f', 'c53b92f4-e0af-463a-896f-17b9409c602c', '3820b0b5-0428-442c-a0d2-2e0f132c9a54'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:06 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:11:06 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:07 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.542s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:07 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] Deleted volume successfully. Sep 28 16:11:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8cf35a75-df55-475e-9800-ceb7b49499e0 tempest-VolumesServicesTestJSON-1560451529 None] Lock "cinder-d6d8a389-c5b7-4c0a-8160-cac9e7696182-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:12 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b99fa33-0585-4f76-9dcf-03ea739af0bf" returned: 0 in 7.930s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3, size 1024.00 MB, duration 7.93 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b99fa33-0585-4f76-9dcf-03ea739af0bf {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:11:13 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Converted 1024.00 MB image at 129.10 MB/s Sep 28 16:11:13 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b99fa33-0585-4f76-9dcf-03ea739af0bf is being set with open permissions: ugo+rw Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b99fa33-0585-4f76-9dcf-03ea739af0bf {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:13 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b99fa33-0585-4f76-9dcf-03ea739af0bf Sep 28 16:11:13 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:13 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b99fa33-0585-4f76-9dcf-03ea739af0bf" returned: 0 in 0.311s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-7b99fa33-0585-4f76-9dcf-03ea739af0bf" released by "_copy_volume_from_snapshot" :: held 9.231s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=139,cinder:DELETE=14,cinder:SELECT=101,cinder:INSERT=29 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-11064b19-548d-47ca-8de5-f03f9c7cf021-7b99fa33-0585-4f76-9dcf-03ea739af0bf" released by "_create_volume_from_snapshot" :: held 9.353s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.391s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.682s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=84bc0e72-2b88-42de-86ab-2db609cb1037,created_at=2026-09-28T14:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2082003996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84bc0e72-2b88-42de-86ab-2db609cb1037,host='devstack@QuobyteHD#QuobyteHD',id=4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5990d7250b2344789366347a646ea103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:05Z,use_quota=True,user_id='ad889429d28a4a5285063bb0f3350366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fbb6cb6-5fa3-4be8-94fb-2b3487a02bac),volume_type_id=0fbb6cb6-5fa3-4be8-94fb-2b3487a02bac)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Creating volume 4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:11:13 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:13 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e 1073741824 Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633b5db9-8a53-4e78-b5a7-34edb13bc41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b99fa33-0585-4f76-9dcf-03ea739af0bf', 'volume_size': 2, 'snapshot_id': '11064b19-548d-47ca-8de5-f03f9c7cf021'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:13 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881ed592-6541-4e6b-85dd-ca6053852cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:13 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Volume volume-7b99fa33-0585-4f76-9dcf-03ea739af0bf (7b99fa33-0585-4f76-9dcf-03ea739af0bf): created successfully Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881ed592-6541-4e6b-85dd-ca6053852cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Flow 'volume_create_manager' (8d13f0ab-ac28-4e32-9423-ca6e14375dbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:13 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b4fe6c3a-f23a-48ac-9c98-79a5a949833f tempest-VolumesSnapshotTestJSON-1935054028 None] Created volume successfully. Sep 28 16:11:14 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e 1073741824" returned: 0 in 0.604s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:14 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e Sep 28 16:11:14 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:14 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e" returned: 0 in 0.365s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:11:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07233a1e-6c6d-41b3-ba02-cf72b1cf449f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e4cf35-e927-4362-ae2c-ef19cd308017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:14 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Volume volume-4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e (4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e): created successfully Sep 28 16:11:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e4cf35-e927-4362-ae2c-ef19cd308017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Flow 'volume_create_manager' (160ed2a1-1f45-4944-a50e-9df15a085032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:14 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5fc06ded-019e-4f0b-bf95-1bdd825c64e4 tempest-GroupsTest-481770278 None] Created volume successfully. Sep 28 16:11:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-7b99fa33-0585-4f76-9dcf-03ea739af0bf-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-7b99fa33-0585-4f76-9dcf-03ea739af0bf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-quobyte-7b99fa33-0585-4f76-9dcf-03ea739af0bf" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-7b99fa33-0585-4f76-9dcf-03ea739af0bf" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:14 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[510ea462-2797-4868-8865-16617726ac93]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b99fa33-0585-4f76-9dcf-03ea739af0bf {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:14 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b99fa33-0585-4f76-9dcf-03ea739af0bf Sep 28 16:11:14 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:15 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b99fa33-0585-4f76-9dcf-03ea739af0bf" returned: 0 in 0.532s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b99fa33-0585-4f76-9dcf-03ea739af0bf {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:15 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b99fa33-0585-4f76-9dcf-03ea739af0bf Sep 28 16:11:15 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] Acquiring lock "cinder-quobyte-4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] Lock "cinder-quobyte-4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:15 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b99fa33-0585-4f76-9dcf-03ea739af0bf" returned: 0 in 0.385s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:15 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcea23ad-c8ae-4d6e-8ac4-eb09722e36d2]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-7b99fa33-0585-4f76-9dcf-03ea739af0bf" released by "delete_volume" :: held 1.014s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:15 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] Created reservations ['d05d8600-0c69-47d7-b872-e8e66dde22a2', '135b1023-e951-45ef-9564-2f7e42c34fc0', '86fee62d-3366-43a0-8408-55071a9cf328', '330107ec-c5dc-4bba-ae34-6927a879ef57'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:15 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e Sep 28 16:11:15 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:15 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:11:15 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:16 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e" returned: 0 in 0.521s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:16 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.304s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:16 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e Sep 28 16:11:16 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:16 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:16 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] Deleted volume successfully. Sep 28 16:11:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-10d65d82-ac3a-4122-8a80-568d9f4fa9d8 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-7b99fa33-0585-4f76-9dcf-03ea739af0bf-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:16 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e" returned: 0 in 0.332s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] Lock "cinder-quobyte-4fe34c12-68ef-4bdc-bbfd-ded3a427ad1e" released by "delete_volume" :: held 0.920s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:16 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] Created reservations ['25d092ea-6e27-46f4-a6f8-78f06af2483e'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:16 devstack cinder-volume[87087]: WARNING cinder.quota [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-331144349 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-331144349, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:11:16 devstack cinder-volume[87087]: WARNING cinder.quota [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-331144349 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-331144349, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:11:16 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] Created reservations ['ae1af5f0-fc8c-4576-b58b-335820364a9c', 'ab963d84-4e72-433c-89c3-71deede2c530', 'acf43f39-f315-4ba4-a143-34ea9679de72', '22d65e56-9015-4fd3-941a-78ed192fc1b7'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:16 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:11:16 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-11064b19-548d-47ca-8de5-f03f9c7cf021-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-11064b19-548d-47ca-8de5-f03f9c7cf021-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-quobyte-55cfa236-e324-40c6-bc3e-b279bb920ec3" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-55cfa236-e324-40c6-bc3e-b279bb920ec3" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-quobyte-11064b19-548d-47ca-8de5-f03f9c7cf021" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-11064b19-548d-47ca-8de5-f03f9c7cf021" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] Deleting offline snapshot 11064b19-548d-47ca-8de5-f03f9c7cf021 of volume 55cfa236-e324-40c6-bc3e-b279bb920ec3 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] snapshot_file for this snap is: volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1386faf7-5e67-433b-b090-fe7a7d3f75ec]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-0940bf05-b7fa-4cec-bded-dd8ad17297ec tempest-GroupsTest-481770278 None] Created reservations ['ac7884ba-e59d-46a3-b3fa-9191449f3a6a'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:17 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.379s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:17 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-209755b0-c444-47e2-a853-43f00131c9a1 tempest-GroupsTest-481770278 None] Delete group completed successfully. Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0940bf05-b7fa-4cec-bded-dd8ad17297ec tempest-GroupsTest-481770278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0940bf05-b7fa-4cec-bded-dd8ad17297ec tempest-GroupsTest-481770278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0940bf05-b7fa-4cec-bded-dd8ad17297ec tempest-GroupsTest-481770278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0940bf05-b7fa-4cec-bded-dd8ad17297ec tempest-GroupsTest-481770278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0940bf05-b7fa-4cec-bded-dd8ad17297ec tempest-GroupsTest-481770278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0940bf05-b7fa-4cec-bded-dd8ad17297ec tempest-GroupsTest-481770278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:17 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:11:17 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:17 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021 Sep 28 16:11:17 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:17 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0940bf05-b7fa-4cec-bded-dd8ad17297ec tempest-GroupsTest-481770278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.331s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-0940bf05-b7fa-4cec-bded-dd8ad17297ec tempest-GroupsTest-481770278 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:17 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0940bf05-b7fa-4cec-bded-dd8ad17297ec tempest-GroupsTest-481770278 None] Delete group completed successfully. Sep 28 16:11:17 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021" returned: 0 in 0.555s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55cfa236-e324-40c6-bc3e-b279bb920ec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37a825d-349f-4318-939a-934a085d75f6]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:17 devstack sudo[99076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 Sep 28 16:11:17 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:18 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3" returned: 0 in 0.708s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:18 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021 Sep 28 16:11:18 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-27572ed9-9a3c-40c0-93ee-923d57618500 tempest-GroupsTest-481770278 None] Group tempest-GroupsTest-Group-139224635: creating Sep 28 16:11:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-27572ed9-9a3c-40c0-93ee-923d57618500 tempest-GroupsTest-481770278 None] Group tempest-GroupsTest-Group-139224635: created successfully Sep 28 16:11:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-27572ed9-9a3c-40c0-93ee-923d57618500 tempest-GroupsTest-481770278 None] Create group completed successfully. Sep 28 16:11:19 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021" returned: 0 in 0.745s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:19 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021 Sep 28 16:11:19 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:19 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3.11064b19-548d-47ca-8de5-f03f9c7cf021" returned: 0 in 0.341s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-11064b19-548d-47ca-8de5-f03f9c7cf021" released by "_delete_snapshot" :: held 2.505s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-55cfa236-e324-40c6-bc3e-b279bb920ec3" released by "delete_snapshot" :: held 2.555s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:19 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] Created reservations ['caf3c0f7-69d1-487e-b3c1-a81b612b62ca', 'dbf430ca-e6ac-4afd-b3df-a6921ee63070', '5a7952f1-0aec-4ca8-be88-9cfa557013cf', '93b44e1f-4d8f-4d15-8ec4-f075cfbb96a2'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] Delete snapshot completed successfully. Sep 28 16:11:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ba6074d-d797-418a-8258-5668274f43f3 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-11064b19-548d-47ca-8de5-f03f9c7cf021-delete_snapshot" released by "delete_snapshot" :: held 2.838s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-55cfa236-e324-40c6-bc3e-b279bb920ec3-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-55cfa236-e324-40c6-bc3e-b279bb920ec3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-quobyte-55cfa236-e324-40c6-bc3e-b279bb920ec3" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-55cfa236-e324-40c6-bc3e-b279bb920ec3" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64c8879-e98b-4960-ad81-b2d682495c69]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:20 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 Sep 28 16:11:20 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Flow 'volume_create_manager' (31e9fbaa-06c6-45ff-8cae-a0e1cbb922cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd82730f-b9f4-4ac4-b9f9-8103cbe3cf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:21 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd82730f-b9f4-4ac4-b9f9-8103cbe3cf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1450443410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d227d12-97e6-428c-9a11-451c3d480d8c,host='devstack@QuobyteHD#QuobyteHD',id=99da8cc3-cb90-48f0-8b28-690ec8dc19aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5990d7250b2344789366347a646ea103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:21Z,use_quota=True,user_id='ad889429d28a4a5285063bb0f3350366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11f0239f-bc78-4e02-a32e-6c1770146f54),volume_type_id=11f0239f-bc78-4e02-a32e-6c1770146f54)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76fbd503-bf88-42f7-a988-5b04a8913459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76fbd503-bf88-42f7-a988-5b04a8913459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c74f73-3c87-47de-82b3-0b16aca437e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c74f73-3c87-47de-82b3-0b16aca437e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99da8cc3-cb90-48f0-8b28-690ec8dc19aa', 'volume_name': 'volume-99da8cc3-cb90-48f0-8b28-690ec8dc19aa', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7ff564-814c-4655-a70d-25530d677892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7ff564-814c-4655-a70d-25530d677892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cef46b4-8506-4d63-bf55-437939badbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:21 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Volume 99da8cc3-cb90-48f0-8b28-690ec8dc19aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99da8cc3-cb90-48f0-8b28-690ec8dc19aa', 'volume_size': 1} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8d227d12-97e6-428c-9a11-451c3d480d8c,created_at=2026-09-28T14:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1450443410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d227d12-97e6-428c-9a11-451c3d480d8c,host='devstack@QuobyteHD#QuobyteHD',id=99da8cc3-cb90-48f0-8b28-690ec8dc19aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5990d7250b2344789366347a646ea103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:21Z,use_quota=True,user_id='ad889429d28a4a5285063bb0f3350366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11f0239f-bc78-4e02-a32e-6c1770146f54),volume_type_id=11f0239f-bc78-4e02-a32e-6c1770146f54)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Creating volume 99da8cc3-cb90-48f0-8b28-690ec8dc19aa {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:11:21 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-99da8cc3-cb90-48f0-8b28-690ec8dc19aa 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3" returned: 0 in 0.717s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:21 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-99da8cc3-cb90-48f0-8b28-690ec8dc19aa 1073741824 Sep 28 16:11:21 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:21 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3 Sep 28 16:11:21 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:21 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-55cfa236-e324-40c6-bc3e-b279bb920ec3" returned: 0 in 0.351s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-55cfa236-e324-40c6-bc3e-b279bb920ec3" released by "delete_volume" :: held 1.176s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] Created reservations ['6a2d5aef-16bb-4df8-8066-95f98af97065', '90b50e91-399c-4780-b24b-b9edae18e4de', '5d7e99ff-2573-4e9b-b5f6-692e45de3271', '49aa0bd1-92cb-42ae-af89-bf0443fca20b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:21 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:11:21 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:22 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-99da8cc3-cb90-48f0-8b28-690ec8dc19aa 1073741824" returned: 0 in 0.726s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-99da8cc3-cb90-48f0-8b28-690ec8dc19aa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:22 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-99da8cc3-cb90-48f0-8b28-690ec8dc19aa Sep 28 16:11:22 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:22 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.323s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:22 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:22 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] Deleted volume successfully. Sep 28 16:11:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-644a77e3-041f-49b5-8f7e-7c38b96cd9ef tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-55cfa236-e324-40c6-bc3e-b279bb920ec3-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:22 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-99da8cc3-cb90-48f0-8b28-690ec8dc19aa" returned: 0 in 0.333s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:11:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cef46b4-8506-4d63-bf55-437939badbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99da8cc3-cb90-48f0-8b28-690ec8dc19aa', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bdac485-26bc-469d-a9a4-f342f5a26357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:22 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Volume volume-99da8cc3-cb90-48f0-8b28-690ec8dc19aa (99da8cc3-cb90-48f0-8b28-690ec8dc19aa): created successfully Sep 28 16:11:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bdac485-26bc-469d-a9a4-f342f5a26357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Flow 'volume_create_manager' (31e9fbaa-06c6-45ff-8cae-a0e1cbb922cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:22 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2c77db6e-ee93-45a1-96e3-6a91a40837d6 tempest-GroupsTest-481770278 None] Created volume successfully. Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Flow 'volume_create_manager' (5af1a1e2-fa90-4f68-828c-28f5d902fd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee8a71b-1ffb-47ba-94a5-4678a3989d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee8a71b-1ffb-47ba-94a5-4678a3989d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-751489647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a54a6f2-8363-40d7-a989-537dd80d5d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c897809efa5475eb9f7b333f207dd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:23Z,use_quota=True,user_id='652d3e75f4ac4baab0b2057533c79e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6401ab-1e7c-4467-8989-3b4a16bb52bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6401ab-1e7c-4467-8989-3b4a16bb52bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0fbfee-bec7-4281-bd19-72b90e9bed09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0fbfee-bec7-4281-bd19-72b90e9bed09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a54a6f2-8363-40d7-a989-537dd80d5d3b', 'volume_name': 'volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1898c3-2060-4cd6-8c1c-46bb26d71351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1898c3-2060-4cd6-8c1c-46bb26d71351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2209a69-b9d6-4991-8ff6-96f9e14bedc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:23 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Volume 7a54a6f2-8363-40d7-a989-537dd80d5d3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b', 'volume_size': 1} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-751489647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a54a6f2-8363-40d7-a989-537dd80d5d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c897809efa5475eb9f7b333f207dd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:23Z,use_quota=True,user_id='652d3e75f4ac4baab0b2057533c79e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Creating volume 7a54a6f2-8363-40d7-a989-537dd80d5d3b {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:11:23 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:11:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:23 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b 1073741824 Sep 28 16:11:23 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:24 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b 1073741824" returned: 0 in 0.614s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:24 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b Sep 28 16:11:24 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Flow 'volume_create_manager' (6d47fb9f-5d24-40a8-8e9c-1c7cb3c53549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2aba4b-3745-429a-93e6-642d223419e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2aba4b-3745-429a-93e6-642d223419e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1576558930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d227d12-97e6-428c-9a11-451c3d480d8c,host='devstack@QuobyteHD#QuobyteHD',id=39fc644e-d8db-4ace-b3a4-12bef2cbd381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5990d7250b2344789366347a646ea103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:24Z,use_quota=True,user_id='ad889429d28a4a5285063bb0f3350366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11f0239f-bc78-4e02-a32e-6c1770146f54),volume_type_id=11f0239f-bc78-4e02-a32e-6c1770146f54)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4d8782-98af-47d2-94cc-207ec8e7c795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4d8782-98af-47d2-94cc-207ec8e7c795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097ec238-5a8f-4fb4-83ac-77886ea7f7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097ec238-5a8f-4fb4-83ac-77886ea7f7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39fc644e-d8db-4ace-b3a4-12bef2cbd381', 'volume_name': 'volume-39fc644e-d8db-4ace-b3a4-12bef2cbd381', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d81d53-06b4-4ae5-9277-90e543673ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d81d53-06b4-4ae5-9277-90e543673ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a93c8e-27bd-4206-8fac-7552c235c1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:24 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Volume 39fc644e-d8db-4ace-b3a4-12bef2cbd381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39fc644e-d8db-4ace-b3a4-12bef2cbd381', 'volume_size': 1} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:24 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b" returned: 0 in 0.456s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.082s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8d227d12-97e6-428c-9a11-451c3d480d8c,created_at=2026-09-28T14:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1576558930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d227d12-97e6-428c-9a11-451c3d480d8c,host='devstack@QuobyteHD#QuobyteHD',id=39fc644e-d8db-4ace-b3a4-12bef2cbd381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5990d7250b2344789366347a646ea103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:24Z,use_quota=True,user_id='ad889429d28a4a5285063bb0f3350366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11f0239f-bc78-4e02-a32e-6c1770146f54),volume_type_id=11f0239f-bc78-4e02-a32e-6c1770146f54)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Creating volume 39fc644e-d8db-4ace-b3a4-12bef2cbd381 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:11:24 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39fc644e-d8db-4ace-b3a4-12bef2cbd381 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:24 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39fc644e-d8db-4ace-b3a4-12bef2cbd381 1073741824 Sep 28 16:11:24 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2209a69-b9d6-4991-8ff6-96f9e14bedc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd17253-a6ee-42fa-8328-2948d6e3d2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:24 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Volume volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b (7a54a6f2-8363-40d7-a989-537dd80d5d3b): created successfully Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd17253-a6ee-42fa-8328-2948d6e3d2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Flow 'volume_create_manager' (5af1a1e2-fa90-4f68-828c-28f5d902fd0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1f55acd6-60a7-4605-a16e-9aa072ad86ec tempest-VolumesSnapshotTestJSON-1935054028 None] Created volume successfully. Sep 28 16:11:25 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39fc644e-d8db-4ace-b3a4-12bef2cbd381 1073741824" returned: 0 in 0.620s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39fc644e-d8db-4ace-b3a4-12bef2cbd381 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:25 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39fc644e-d8db-4ace-b3a4-12bef2cbd381 Sep 28 16:11:25 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:25 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39fc644e-d8db-4ace-b3a4-12bef2cbd381" returned: 0 in 0.398s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:11:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a93c8e-27bd-4206-8fac-7552c235c1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39fc644e-d8db-4ace-b3a4-12bef2cbd381', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2527ff7c-5b1a-4a72-b319-0208828f985e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:25 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Volume volume-39fc644e-d8db-4ace-b3a4-12bef2cbd381 (39fc644e-d8db-4ace-b3a4-12bef2cbd381): created successfully Sep 28 16:11:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2527ff7c-5b1a-4a72-b319-0208828f985e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Flow 'volume_create_manager' (6d47fb9f-5d24-40a8-8e9c-1c7cb3c53549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:25 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3cdfbdf7-33b9-4a12-b0c3-4951ca1a7474 tempest-GroupsTest-481770278 None] Created volume successfully. Sep 28 16:11:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e61c33f7-d887-4e19-bc38-62dacf4e3b6f tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e61c33f7-d887-4e19-bc38-62dacf4e3b6f tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:26 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:11:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Flow 'volume_create_manager' (949c516f-309e-4848-b57d-3366ef9c2c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d9e4d1-7e70-40bd-87a0-5f813aad428c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e61c33f7-d887-4e19-bc38-62dacf4e3b6f tempest-VolumesSnapshotTestJSON-1935054028 None] Creating offline snapshot a9607bb0-fba9-435d-88cc-5eb5b50eb925 of volume 7a54a6f2-8363-40d7-a989-537dd80d5d3b {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:11:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d9e4d1-7e70-40bd-87a0-5f813aad428c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1030158424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83bb8e8-825a-4933-8e11-0ec55141b88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1846fcae475b410c9d78193c0a1142c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:26Z,use_quota=True,user_id='ed2b583250494bac89274fbeb6333a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a69aaa84-96bc-4949-84d1-749f56247a41),volume_type_id=a69aaa84-96bc-4949-84d1-749f56247a41)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24429f9-11a2-4e2e-811f-8b52f1b81294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24429f9-11a2-4e2e-811f-8b52f1b81294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d677461e-2f3e-4a3e-9494-e364b4dea8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d677461e-2f3e-4a3e-9494-e364b4dea8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b83bb8e8-825a-4933-8e11-0ec55141b88c', 'volume_name': 'volume-b83bb8e8-825a-4933-8e11-0ec55141b88c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d4e167-5747-4075-bdf2-bf2e700a2573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d4e167-5747-4075-bdf2-bf2e700a2573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67253955-a68b-4099-8b87-df826378139a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:26 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Volume b83bb8e8-825a-4933-8e11-0ec55141b88c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b83bb8e8-825a-4933-8e11-0ec55141b88c', 'volume_size': 1} Sep 28 16:11:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:26 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc58be40-7cc8-47de-bd29-fcb21945b12e]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e61c33f7-d887-4e19-bc38-62dacf4e3b6f tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:26 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b Sep 28 16:11:26 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:26 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e61c33f7-d887-4e19-bc38-62dacf4e3b6f tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b" returned: 0 in 0.432s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e61c33f7-d887-4e19-bc38-62dacf4e3b6f tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:26 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925 1G Sep 28 16:11:26 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:27 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e61c33f7-d887-4e19-bc38-62dacf4e3b6f tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925 1G" returned: 0 in 0.502s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e61c33f7-d887-4e19-bc38-62dacf4e3b6f tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:27 devstack sudo[99180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925 Sep 28 16:11:27 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-03a8471d-672a-4178-8f33-33a4f7c91cd0 tempest-GroupsTest-481770278 None] Update group completed successfully. Sep 28 16:11:27 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e61c33f7-d887-4e19-bc38-62dacf4e3b6f tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925" returned: 0 in 0.377s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:27 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-e61c33f7-d887-4e19-bc38-62dacf4e3b6f tempest-VolumesSnapshotTestJSON-1935054028 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925 is being set with open permissions: ugo+rw Sep 28 16:11:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e61c33f7-d887-4e19-bc38-62dacf4e3b6f tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:27 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925 Sep 28 16:11:27 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:27 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e61c33f7-d887-4e19-bc38-62dacf4e3b6f tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925" returned: 0 in 0.287s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e61c33f7-d887-4e19-bc38-62dacf4e3b6f tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:27 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.info Sep 28 16:11:27 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:28 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e61c33f7-d887-4e19-bc38-62dacf4e3b6f tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.info" returned: 0 in 0.302s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:28 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-e61c33f7-d887-4e19-bc38-62dacf4e3b6f tempest-VolumesSnapshotTestJSON-1935054028 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.info is being set with open permissions: ugo+rw Sep 28 16:11:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e61c33f7-d887-4e19-bc38-62dacf4e3b6f tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:28 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.info Sep 28 16:11:28 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:28 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e61c33f7-d887-4e19-bc38-62dacf4e3b6f tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.info" returned: 0 in 0.292s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e61c33f7-d887-4e19-bc38-62dacf4e3b6f tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.381s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.268s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1030158424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83bb8e8-825a-4933-8e11-0ec55141b88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1846fcae475b410c9d78193c0a1142c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:26Z,use_quota=True,user_id='ed2b583250494bac89274fbeb6333a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a69aaa84-96bc-4949-84d1-749f56247a41),volume_type_id=a69aaa84-96bc-4949-84d1-749f56247a41)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:11:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Creating volume b83bb8e8-825a-4933-8e11-0ec55141b88c {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:11:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:11:28 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:11:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b83bb8e8-825a-4933-8e11-0ec55141b88c 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:28 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b83bb8e8-825a-4933-8e11-0ec55141b88c 1073741824 Sep 28 16:11:28 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:28 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e61c33f7-d887-4e19-bc38-62dacf4e3b6f tempest-VolumesSnapshotTestJSON-1935054028 None] Create snapshot completed successfully Sep 28 16:11:28 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f1afca22-1dac-4e20-9c1b-b6447878995b tempest-GroupsTest-481770278 None] Update group completed successfully. Sep 28 16:11:28 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b83bb8e8-825a-4933-8e11-0ec55141b88c 1073741824" returned: 0 in 0.568s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b83bb8e8-825a-4933-8e11-0ec55141b88c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:29 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b83bb8e8-825a-4933-8e11-0ec55141b88c Sep 28 16:11:29 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:29 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b83bb8e8-825a-4933-8e11-0ec55141b88c" returned: 0 in 0.289s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67253955-a68b-4099-8b87-df826378139a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b83bb8e8-825a-4933-8e11-0ec55141b88c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03b7670-358f-4699-823a-5d3f1d03b6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:29 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Volume volume-b83bb8e8-825a-4933-8e11-0ec55141b88c (b83bb8e8-825a-4933-8e11-0ec55141b88c): created successfully Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03b7670-358f-4699-823a-5d3f1d03b6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Flow 'volume_create_manager' (949c516f-309e-4848-b57d-3366ef9c2c7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-bb894ff9-ce8b-4dc0-808c-2c5438d4f1f3 tempest-VolumeTypesAccessTest-70607765 None] Created volume successfully. Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Flow 'volume_create_manager' (4f1aa434-8935-4e6b-8afb-9c677428f8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203cca5e-7e73-4dae-b5f8-6871f312ec58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203cca5e-7e73-4dae-b5f8-6871f312ec58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2013734993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e22207-d0eb-44c9-9636-2575a11f2e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c897809efa5475eb9f7b333f207dd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a9607bb0-fba9-435d-88cc-5eb5b50eb925,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:30Z,use_quota=True,user_id='652d3e75f4ac4baab0b2057533c79e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b833ac-760a-4ed0-bc78-103a07a66e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b833ac-760a-4ed0-bc78-103a07a66e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b05911c-2df2-4060-b084-dae1eea124dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b05911c-2df2-4060-b084-dae1eea124dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '91e22207-d0eb-44c9-9636-2575a11f2e69', 'volume_name': 'volume-91e22207-d0eb-44c9-9636-2575a11f2e69', 'volume_size': 1, 'snapshot_id': 'a9607bb0-fba9-435d-88cc-5eb5b50eb925'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b432aebc-e58b-452d-960d-f955160095e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b432aebc-e58b-452d-960d-f955160095e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a06903af-de53-42d9-a6b1-a92222b1689a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:29 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Volume 91e22207-d0eb-44c9-9636-2575a11f2e69: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-91e22207-d0eb-44c9-9636-2575a11f2e69', 'volume_size': 1, 'snapshot_id': 'a9607bb0-fba9-435d-88cc-5eb5b50eb925'} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-quobyte-a9607bb0-fba9-435d-88cc-5eb5b50eb925-91e22207-d0eb-44c9-9636-2575a11f2e69" by "_create_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-a9607bb0-fba9-435d-88cc-5eb5b50eb925-91e22207-d0eb-44c9-9636-2575a11f2e69" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Creating volume 91e22207-d0eb-44c9-9636-2575a11f2e69 from snapshot a9607bb0-fba9-435d-88cc-5eb5b50eb925 {{(pid=87087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-quobyte-91e22207-d0eb-44c9-9636-2575a11f2e69" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-91e22207-d0eb-44c9-9636-2575a11f2e69" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] snapshot: a9607bb0-fba9-435d-88cc-5eb5b50eb925, volume: 91e22207-d0eb-44c9-9636-2575a11f2e69, {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:30 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[517457c4-d458-452c-a9ea-1017e0ebb1bf]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:30 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925 Sep 28 16:11:30 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] Acquiring lock "cinder-b83bb8e8-825a-4933-8e11-0ec55141b88c-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] Lock "cinder-b83bb8e8-825a-4933-8e11-0ec55141b88c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:30 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925" returned: 0 in 0.500s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:11:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] Acquiring lock "cinder-quobyte-b83bb8e8-825a-4933-8e11-0ec55141b88c" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] Lock "cinder-quobyte-b83bb8e8-825a-4933-8e11-0ec55141b88c" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:30 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6a44c5-f2dd-41ba-9268-9c58d91dee94]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:30 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee7795c-3654-4e43-985d-144dd2a864d5]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b83bb8e8-825a-4933-8e11-0ec55141b88c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Acquiring lock "cinder-quobyte-39fc644e-d8db-4ace-b3a4-12bef2cbd381" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Lock "cinder-quobyte-39fc644e-d8db-4ace-b3a4-12bef2cbd381" acquired by "delete_volume" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:30 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b Sep 28 16:11:30 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae0b615-4425-4d1d-a6c8-bc0e28ec57ea]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:30 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39fc644e-d8db-4ace-b3a4-12bef2cbd381 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:30 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b83bb8e8-825a-4933-8e11-0ec55141b88c Sep 28 16:11:30 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:30 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39fc644e-d8db-4ace-b3a4-12bef2cbd381 Sep 28 16:11:30 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:31 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b" returned: 0 in 0.475s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Path /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91e22207-d0eb-44c9-9636-2575a11f2e69 not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91e22207-d0eb-44c9-9636-2575a11f2e69 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:31 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91e22207-d0eb-44c9-9636-2575a11f2e69 Sep 28 16:11:31 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:31 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b83bb8e8-825a-4933-8e11-0ec55141b88c" returned: 0 in 0.537s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b83bb8e8-825a-4933-8e11-0ec55141b88c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:31 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b83bb8e8-825a-4933-8e11-0ec55141b88c Sep 28 16:11:31 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:31 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39fc644e-d8db-4ace-b3a4-12bef2cbd381" returned: 0 in 0.465s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39fc644e-d8db-4ace-b3a4-12bef2cbd381 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:31 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39fc644e-d8db-4ace-b3a4-12bef2cbd381 Sep 28 16:11:31 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:31 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b83bb8e8-825a-4933-8e11-0ec55141b88c" returned: 0 in 0.299s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] Lock "cinder-quobyte-b83bb8e8-825a-4933-8e11-0ec55141b88c" released by "delete_volume" :: held 0.911s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:31 devstack cinder-volume[87087]: WARNING cinder.quota [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-374393129 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-374393129, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:11:31 devstack cinder-volume[87087]: WARNING cinder.quota [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-374393129 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-374393129, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:11:31 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-39fc644e-d8db-4ace-b3a4-12bef2cbd381" returned: 0 in 0.311s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Lock "cinder-quobyte-39fc644e-d8db-4ace-b3a4-12bef2cbd381" released by "delete_volume" :: held 0.856s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Acquiring lock "cinder-quobyte-99da8cc3-cb90-48f0-8b28-690ec8dc19aa" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] Created reservations ['f582014c-d144-4f2c-80e9-ce38ac703600', '38814f14-b650-4963-a70a-1abac0c25848', '2d264655-6800-4bdc-9c56-ed0d08228151', '44a5b6f6-b06f-49a0-aeec-b7c36119fb7d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Lock "cinder-quobyte-99da8cc3-cb90-48f0-8b28-690ec8dc19aa" acquired by "delete_volume" :: waited 0.035s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3789ab8-30c9-49d3-8f49-da4175d06e2c]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-99da8cc3-cb90-48f0-8b28-690ec8dc19aa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:31 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:11:31 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:31 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-99da8cc3-cb90-48f0-8b28-690ec8dc19aa Sep 28 16:11:31 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:32 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.711s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:32 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:32 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] Deleted volume successfully. Sep 28 16:11:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d738679b-babc-499c-84ac-554f12deb616 tempest-VolumeTypesAccessTest-70607765 None] Lock "cinder-b83bb8e8-825a-4933-8e11-0ec55141b88c-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:32 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-99da8cc3-cb90-48f0-8b28-690ec8dc19aa" returned: 0 in 0.972s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-99da8cc3-cb90-48f0-8b28-690ec8dc19aa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:32 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-99da8cc3-cb90-48f0-8b28-690ec8dc19aa Sep 28 16:11:32 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:33 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-99da8cc3-cb90-48f0-8b28-690ec8dc19aa" returned: 0 in 0.550s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Lock "cinder-quobyte-99da8cc3-cb90-48f0-8b28-690ec8dc19aa" released by "delete_volume" :: held 1.605s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:33 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Created reservations ['d9d59a36-e4f2-439b-9417-aa5a3cff7326'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:33 devstack cinder-volume[87087]: WARNING cinder.quota [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-901676042 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-901676042, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:11:33 devstack cinder-volume[87087]: WARNING cinder.quota [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-901676042 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-901676042, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:11:33 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Created reservations ['623b19fe-af1d-41d2-825d-352d296c7dda', 'f6cb45c3-a7c7-4e61-857a-3c28122a343e', '09a20bc1-541c-4f74-8ea3-6a9d598a8dfb', '5f0e6fc5-0fdf-4d4f-bed8-5875d5171f15'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:33 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Created reservations ['8763b657-108f-4b43-af9c-d08df36c59fb', '9b95f5d6-a6a0-421b-8f9e-866c98779536', 'bc875cce-ce78-4b3b-8033-68cd7461fd29', 'e2ebafc2-84b0-418c-8baa-0bc3b9f64360'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:34 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:11:34 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:34 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.417s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:34 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:34 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-69df7cfa-4901-439d-ad57-491dbf216280 tempest-GroupsTest-481770278 None] Delete group completed successfully. Sep 28 16:11:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:11:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:35 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:11:35 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:35 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.657s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:11:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:11:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:11:39 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91e22207-d0eb-44c9-9636-2575a11f2e69" returned: 0 in 8.493s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:39 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b, size 1024.00 MB, duration 8.49 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91e22207-d0eb-44c9-9636-2575a11f2e69 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:11:39 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Converted 1024.00 MB image at 120.56 MB/s Sep 28 16:11:39 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91e22207-d0eb-44c9-9636-2575a11f2e69 is being set with open permissions: ugo+rw Sep 28 16:11:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91e22207-d0eb-44c9-9636-2575a11f2e69 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:39 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91e22207-d0eb-44c9-9636-2575a11f2e69 Sep 28 16:11:39 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:39 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91e22207-d0eb-44c9-9636-2575a11f2e69" returned: 0 in 0.348s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-91e22207-d0eb-44c9-9636-2575a11f2e69" released by "_copy_volume_from_snapshot" :: held 9.962s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-a9607bb0-fba9-435d-88cc-5eb5b50eb925-91e22207-d0eb-44c9-9636-2575a11f2e69" released by "_create_volume_from_snapshot" :: held 10.075s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.090s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a06903af-de53-42d9-a6b1-a92222b1689a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e22207-d0eb-44c9-9636-2575a11f2e69', 'volume_size': 1, 'snapshot_id': 'a9607bb0-fba9-435d-88cc-5eb5b50eb925'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a9f483-c1df-4bc7-8b86-0d077dae21ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:40 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Volume volume-91e22207-d0eb-44c9-9636-2575a11f2e69 (91e22207-d0eb-44c9-9636-2575a11f2e69): created successfully Sep 28 16:11:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a9f483-c1df-4bc7-8b86-0d077dae21ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Flow 'volume_create_manager' (4f1aa434-8935-4e6b-8afb-9c677428f8a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:40 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6a6ce1dd-0f46-4286-92a4-446394406476 tempest-VolumesSnapshotTestJSON-1935054028 None] Created volume successfully. Sep 28 16:11:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-91e22207-d0eb-44c9-9636-2575a11f2e69-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-91e22207-d0eb-44c9-9636-2575a11f2e69-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-quobyte-91e22207-d0eb-44c9-9636-2575a11f2e69" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-91e22207-d0eb-44c9-9636-2575a11f2e69" acquired by "delete_volume" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:40 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[38da8e4e-af48-4c9b-9cc8-809fb97fcef5]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91e22207-d0eb-44c9-9636-2575a11f2e69 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:40 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91e22207-d0eb-44c9-9636-2575a11f2e69 Sep 28 16:11:40 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:41 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91e22207-d0eb-44c9-9636-2575a11f2e69" returned: 0 in 0.578s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91e22207-d0eb-44c9-9636-2575a11f2e69 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:41 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91e22207-d0eb-44c9-9636-2575a11f2e69 Sep 28 16:11:41 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:41 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91e22207-d0eb-44c9-9636-2575a11f2e69" returned: 0 in 0.393s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-91e22207-d0eb-44c9-9636-2575a11f2e69" released by "delete_volume" :: held 1.047s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:41 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] Created reservations ['eab08c84-4610-4ecb-b782-4ddccc929181', '47c4b473-9f78-4a41-9c09-e0234a664594', '7e8d2959-328d-4865-bded-c6a4a0ebcbf9', 'b71b2b83-669a-4629-92aa-5a02467d8ca8'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:41 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:11:41 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:42 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.348s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:42 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] Deleted volume successfully. Sep 28 16:11:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9e840ad8-8d19-44ed-8753-6f82f2f08525 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-91e22207-d0eb-44c9-9636-2575a11f2e69-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-a9607bb0-fba9-435d-88cc-5eb5b50eb925-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-a9607bb0-fba9-435d-88cc-5eb5b50eb925-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-quobyte-7a54a6f2-8363-40d7-a989-537dd80d5d3b" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-7a54a6f2-8363-40d7-a989-537dd80d5d3b" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-quobyte-a9607bb0-fba9-435d-88cc-5eb5b50eb925" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-a9607bb0-fba9-435d-88cc-5eb5b50eb925" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] Deleting offline snapshot a9607bb0-fba9-435d-88cc-5eb5b50eb925 of volume 7a54a6f2-8363-40d7-a989-537dd80d5d3b {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:11:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] snapshot_file for this snap is: volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:11:42 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ba0701-afd7-4ad2-9f8b-27b177ced2ec]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:43 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925 Sep 28 16:11:43 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:43 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925" returned: 0 in 0.480s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:11:43 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7a67ad-f302-491a-b54c-f10a13003d5c]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:43 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b Sep 28 16:11:43 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:44 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b" returned: 0 in 0.718s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:44 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925 Sep 28 16:11:44 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:44 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925" returned: 0 in 0.473s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:44 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925 Sep 28 16:11:44 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:45 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b.a9607bb0-fba9-435d-88cc-5eb5b50eb925" returned: 0 in 0.329s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-a9607bb0-fba9-435d-88cc-5eb5b50eb925" released by "_delete_snapshot" :: held 2.165s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-7a54a6f2-8363-40d7-a989-537dd80d5d3b" released by "delete_snapshot" :: held 2.206s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:45 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=142,cinder:UPDATE=142,cinder:INSERT=31,cinder:DELETE=10 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:11:45 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] Created reservations ['b7ff15c1-7439-418a-bfe8-125ae704e356', '16b8d58a-ecfd-4c61-ae38-224ba1a3beea', 'c065f6b2-cb46-4c4f-a359-7360b6483959', '5a46aafe-3a93-48c9-8585-a6c8e16fb810'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:45 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] Delete snapshot completed successfully. Sep 28 16:11:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2362ecab-0526-4f5f-b785-560923a77bcf tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-a9607bb0-fba9-435d-88cc-5eb5b50eb925-delete_snapshot" released by "delete_snapshot" :: held 2.454s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:45 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e65437e7-897b-4e83-9b18-41c8e6c81a58 tempest-GroupsV314Test-25714432 None] Group tempest-GroupsV314Test-Group-928010582: creating Sep 28 16:11:45 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e65437e7-897b-4e83-9b18-41c8e6c81a58 tempest-GroupsV314Test-25714432 None] Group tempest-GroupsV314Test-Group-928010582: created successfully Sep 28 16:11:45 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e65437e7-897b-4e83-9b18-41c8e6c81a58 tempest-GroupsV314Test-25714432 None] Create group completed successfully. Sep 28 16:11:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-7a54a6f2-8363-40d7-a989-537dd80d5d3b-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-7a54a6f2-8363-40d7-a989-537dd80d5d3b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-quobyte-7a54a6f2-8363-40d7-a989-537dd80d5d3b" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-7a54a6f2-8363-40d7-a989-537dd80d5d3b" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:46 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2456778-c12a-42a0-b8a3-7d4b96614890]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:46 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b Sep 28 16:11:46 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:46 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b" returned: 0 in 0.463s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:46 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b Sep 28 16:11:46 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:47 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7a54a6f2-8363-40d7-a989-537dd80d5d3b" returned: 0 in 0.379s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-7a54a6f2-8363-40d7-a989-537dd80d5d3b" released by "delete_volume" :: held 0.930s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] Created reservations ['16835306-d89a-4605-95e9-ae0bdd46e7f3', 'e0d12a44-7f4d-4572-995e-5e9469a69095', '18d93aa2-01d1-4eeb-a235-abc8e02226df', '37e0e282-929e-4700-8d9b-696135a78790'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:47 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:11:47 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-127523ee-ff09-4dbf-83e2-3fd0b4391f51-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-127523ee-ff09-4dbf-83e2-3fd0b4391f51-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "cinder-quobyte-127523ee-ff09-4dbf-83e2-3fd0b4391f51" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-127523ee-ff09-4dbf-83e2-3fd0b4391f51" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d5aecd-3ff1-4478-b0b2-d45dd2c1af92]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:11:47 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Flow 'volume_create_manager' (d8502381-6781-4776-a881-b65c5271625b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c8ef30-bfa7-45b4-b7ec-282afb764f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.463s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] Deleted volume successfully. Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c8ef30-bfa7-45b4-b7ec-282afb764f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1705539914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b2e3d72-227e-4ec1-bd86-7b0211181d75,host='devstack@QuobyteHD#QuobyteHD',id=cc3078a3-5be0-45a4-b39e-342f9470a859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a3f75f7d8ff47d88907f8b9b85edc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:48Z,use_quota=True,user_id='95e9382fa00240c4ba34aada03b6f7f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d01cc4e-2a55-4c94-9966-a46e232f08af),volume_type_id=2d01cc4e-2a55-4c94-9966-a46e232f08af)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0641d998-7fc0-413c-9034-03404e1191bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:47 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51 Sep 28 16:11:47 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0641d998-7fc0-413c-9034-03404e1191bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fbd392-1b93-443b-aef0-d95b7a30372e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fbd392-1b93-443b-aef0-d95b7a30372e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc3078a3-5be0-45a4-b39e-342f9470a859', 'volume_name': 'volume-cc3078a3-5be0-45a4-b39e-342f9470a859', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52df0712-9f41-449d-8037-6091d5090d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52df0712-9f41-449d-8037-6091d5090d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d12ea9-6f66-4402-8f1c-56c0f7b5b16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:47 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Volume cc3078a3-5be0-45a4-b39e-342f9470a859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc3078a3-5be0-45a4-b39e-342f9470a859', 'volume_size': 1} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9b2e3d72-227e-4ec1-bd86-7b0211181d75,created_at=2026-09-28T14:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1705539914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b2e3d72-227e-4ec1-bd86-7b0211181d75,host='devstack@QuobyteHD#QuobyteHD',id=cc3078a3-5be0-45a4-b39e-342f9470a859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a3f75f7d8ff47d88907f8b9b85edc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:48Z,use_quota=True,user_id='95e9382fa00240c4ba34aada03b6f7f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d01cc4e-2a55-4c94-9966-a46e232f08af),volume_type_id=2d01cc4e-2a55-4c94-9966-a46e232f08af)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Creating volume cc3078a3-5be0-45a4-b39e-342f9470a859 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:11:48 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:48 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859 1073741824 Sep 28 16:11:48 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd8e73e9-c670-4a28-bc5e-877514b93b54 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-7a54a6f2-8363-40d7-a989-537dd80d5d3b-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:48 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51" returned: 0 in 0.532s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:48 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51 Sep 28 16:11:48 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:48 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859 1073741824" returned: 0 in 0.593s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:48 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-127523ee-ff09-4dbf-83e2-3fd0b4391f51" returned: 0 in 0.337s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:48 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859 Sep 28 16:11:48 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-quobyte-127523ee-ff09-4dbf-83e2-3fd0b4391f51" released by "delete_volume" :: held 1.007s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] Created reservations ['e0df3a7b-30f1-47a4-8225-010d14b50054', 'b28f696a-db2c-42f6-8c5e-c35bae008c39', '01217953-9839-4207-9e88-8dafb52f08d8', '1b6d177b-0cc7-4d83-a6ff-80ee492cbb41'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:49 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:11:49 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:49 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859" returned: 0 in 0.408s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:11:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d12ea9-6f66-4402-8f1c-56c0f7b5b16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc3078a3-5be0-45a4-b39e-342f9470a859', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa8201d-b1f7-4c45-9ce2-1bdf2b120db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:49 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Volume volume-cc3078a3-5be0-45a4-b39e-342f9470a859 (cc3078a3-5be0-45a4-b39e-342f9470a859): created successfully Sep 28 16:11:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa8201d-b1f7-4c45-9ce2-1bdf2b120db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Flow 'volume_create_manager' (d8502381-6781-4776-a881-b65c5271625b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b011a056-4939-4d8a-b229-54df7cac2e5b tempest-GroupsV314Test-25714432 None] Created volume successfully. Sep 28 16:11:49 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.335s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:49 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] Deleted volume successfully. Sep 28 16:11:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5527da7d-1e56-49ff-a81b-be182ed3f2b5 tempest-VolumesSnapshotTestJSON-1935054028 None] Lock "cinder-127523ee-ff09-4dbf-83e2-3fd0b4391f51-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Flow 'volume_create_manager' (d931b627-8ef7-4310-a342-51168e59a82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab27848-5657-4d35-bd1c-e48a1af7eb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab27848-5657-4d35-bd1c-e48a1af7eb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1779599324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4798bd2-b34e-491c-ba06-58ecf3705613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cbc1c49541f4f01bd0e3e727e54c80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:50Z,use_quota=True,user_id='8859a0790a27491e97b347c7e13f762e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ad9d31-1292-4c12-98d5-369e79bc1390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ad9d31-1292-4c12-98d5-369e79bc1390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14be7641-4372-4fe9-8d36-a58be0b0a3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14be7641-4372-4fe9-8d36-a58be0b0a3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4798bd2-b34e-491c-ba06-58ecf3705613', 'volume_name': 'volume-e4798bd2-b34e-491c-ba06-58ecf3705613', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3300c0-6e86-4d47-a72e-cb6b413fd228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3300c0-6e86-4d47-a72e-cb6b413fd228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e236b280-0e50-4076-9dbd-6f85eef08250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:50 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Volume e4798bd2-b34e-491c-ba06-58ecf3705613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4798bd2-b34e-491c-ba06-58ecf3705613', 'volume_size': 1} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1779599324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4798bd2-b34e-491c-ba06-58ecf3705613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cbc1c49541f4f01bd0e3e727e54c80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:50Z,use_quota=True,user_id='8859a0790a27491e97b347c7e13f762e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Creating volume e4798bd2-b34e-491c-ba06-58ecf3705613 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:11:50 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4798bd2-b34e-491c-ba06-58ecf3705613 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:50 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4798bd2-b34e-491c-ba06-58ecf3705613 1073741824 Sep 28 16:11:50 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:50 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4798bd2-b34e-491c-ba06-58ecf3705613 1073741824" returned: 0 in 0.552s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4798bd2-b34e-491c-ba06-58ecf3705613 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:50 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4798bd2-b34e-491c-ba06-58ecf3705613 Sep 28 16:11:50 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:51 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4798bd2-b34e-491c-ba06-58ecf3705613" returned: 0 in 0.364s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:11:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.059s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:51 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Cloning volume cc3078a3-5be0-45a4-b39e-342f9470a859 to volume 96d7449b-0aa0-4e22-a8c2-7c578ac96f5b Sep 28 16:11:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e236b280-0e50-4076-9dbd-6f85eef08250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4798bd2-b34e-491c-ba06-58ecf3705613', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc1bda0-7bb6-4e48-9bcb-e0ad2b2339a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Creating offline snapshot e8c5fda6-6d1f-4715-bb45-0306d4886fa1 of volume cc3078a3-5be0-45a4-b39e-342f9470a859 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:11:51 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Volume volume-e4798bd2-b34e-491c-ba06-58ecf3705613 (e4798bd2-b34e-491c-ba06-58ecf3705613): created successfully Sep 28 16:11:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc1bda0-7bb6-4e48-9bcb-e0ad2b2339a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Flow 'volume_create_manager' (d931b627-8ef7-4310-a342-51168e59a82e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:51 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[54768c6b-cd31-4320-abe4-f01592a94e46]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:51 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ce995fab-46e0-4ce6-9a1b-f645b59c8283 tempest-VolumesMetadataTest-1227472258 None] Created volume successfully. Sep 28 16:11:51 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859 Sep 28 16:11:51 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:51 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859" returned: 0 in 0.438s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:51 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1 1G Sep 28 16:11:51 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:52 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1 1G" returned: 0 in 0.577s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc3078a3-5be0-45a4-b39e-342f9470a859 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:52 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc3078a3-5be0-45a4-b39e-342f9470a859 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1 Sep 28 16:11:52 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:52 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc3078a3-5be0-45a4-b39e-342f9470a859 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1" returned: 0 in 0.472s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:52 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:11:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:52 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1 Sep 28 16:11:52 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:53 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1" returned: 0 in 0.338s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:53 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.info Sep 28 16:11:53 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] Acquiring lock "cinder-e4798bd2-b34e-491c-ba06-58ecf3705613-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] Lock "cinder-e4798bd2-b34e-491c-ba06-58ecf3705613-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] Acquiring lock "cinder-quobyte-e4798bd2-b34e-491c-ba06-58ecf3705613" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] Lock "cinder-quobyte-e4798bd2-b34e-491c-ba06-58ecf3705613" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e7b4c7-dd82-461b-8ae0-26db71a9eaf0]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4798bd2-b34e-491c-ba06-58ecf3705613 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:53 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.info" returned: 0 in 0.344s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:53 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:53 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4798bd2-b34e-491c-ba06-58ecf3705613 Sep 28 16:11:53 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:53 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.info Sep 28 16:11:53 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:53 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.info" returned: 0 in 0.319s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Acquiring lock "cinder-quobyte-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:53 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4798bd2-b34e-491c-ba06-58ecf3705613" returned: 0 in 0.482s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4798bd2-b34e-491c-ba06-58ecf3705613 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Lock "cinder-quobyte-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] snapshot: e8c5fda6-6d1f-4715-bb45-0306d4886fa1, volume: 96d7449b-0aa0-4e22-a8c2-7c578ac96f5b, {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:11:53 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4798bd2-b34e-491c-ba06-58ecf3705613 Sep 28 16:11:53 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95ca6ba-2490-4027-a64c-e1657517fca4]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:54 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1 Sep 28 16:11:54 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:54 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4798bd2-b34e-491c-ba06-58ecf3705613" returned: 0 in 0.330s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] Lock "cinder-quobyte-e4798bd2-b34e-491c-ba06-58ecf3705613" released by "delete_volume" :: held 0.872s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] Created reservations ['7b1bff7b-bae9-487f-aef0-99e00ac01cc8', '6ba5e9c5-d180-48f6-92e7-21c2918007ba', '47350fe2-e61e-4816-b7e8-9856a5f1591a', 'b87db524-3d6d-4379-9e78-2b3cf0a6d8ea'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:54 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:11:54 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:54 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1" returned: 0 in 0.475s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc3078a3-5be0-45a4-b39e-342f9470a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e61066-135d-49b3-bee1-eb6b74deee69]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:54 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859 Sep 28 16:11:54 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:54 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.335s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:54 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] Deleted volume successfully. Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6395fd0b-c87f-401a-9ab4-d0d2cb4dcc58 tempest-VolumesMetadataTest-1227472258 None] Lock "cinder-e4798bd2-b34e-491c-ba06-58ecf3705613-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:54 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859" returned: 0 in 0.479s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859 {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Path /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:11:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:54 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b Sep 28 16:11:54 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:03 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b" returned: 0 in 8.728s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:03 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859, size 1024.00 MB, duration 8.73 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:12:03 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Converted 1024.00 MB image at 117.30 MB/s Sep 28 16:12:03 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:12:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:03 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b Sep 28 16:12:03 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:04 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b" returned: 0 in 0.377s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Lock "cinder-quobyte-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b" released by "_copy_volume_from_snapshot" :: held 10.163s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Acquiring lock "cinder-quobyte-e8c5fda6-6d1f-4715-bb45-0306d4886fa1" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Lock "cinder-quobyte-e8c5fda6-6d1f-4715-bb45-0306d4886fa1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Deleting offline snapshot e8c5fda6-6d1f-4715-bb45-0306d4886fa1 of volume cc3078a3-5be0-45a4-b39e-342f9470a859 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:12:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] snapshot_file for this snap is: volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:12:04 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c6c558-23bb-48a7-a196-7b969806adc6]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:04 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1 Sep 28 16:12:04 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:04 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1" returned: 0 in 0.531s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc3078a3-5be0-45a4-b39e-342f9470a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:12:04 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:INSERT=7,cinder:UPDATE=34,cinder:SELECT=29,cinder:DELETE=4 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:12:04 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52d6372-7379-4481-8063-8056d0706b0d]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:04 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859 Sep 28 16:12:04 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:05 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859" returned: 0 in 0.823s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:05 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1 Sep 28 16:12:05 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:05 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Flow 'volume_create_manager' (d3ea37d7-f8d8-4c08-a9dc-41e94e11da27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a09d8d7-01cf-4630-bc6b-00a9e402cd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a09d8d7-01cf-4630-bc6b-00a9e402cd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1206637537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee3f3ef-9832-4a7e-b94c-ee1b31978b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf8a631e7754487bcff03efb25ee212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:06Z,use_quota=True,user_id='324c21a12ba44b5f8a37fcd16fd950b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c6f7764-c117-4dbb-b26d-4ae5737e1cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c6f7764-c117-4dbb-b26d-4ae5737e1cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5f8d76-2fc3-48e3-a33f-fd198ac1917c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5f8d76-2fc3-48e3-a33f-fd198ac1917c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ee3f3ef-9832-4a7e-b94c-ee1b31978b45', 'volume_name': 'volume-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b81ca0-f6a2-4ae4-af03-5178e6c5a525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b81ca0-f6a2-4ae4-af03-5178e6c5a525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19725eba-2134-4403-80cd-9ff28953435a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:06 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Volume 7ee3f3ef-9832-4a7e-b94c-ee1b31978b45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45', 'volume_size': 1} Sep 28 16:12:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:06 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1" returned: 0 in 0.536s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:06 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1 Sep 28 16:12:06 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:06 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859.e8c5fda6-6d1f-4715-bb45-0306d4886fa1" returned: 0 in 0.284s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Lock "cinder-quobyte-e8c5fda6-6d1f-4715-bb45-0306d4886fa1" released by "_delete_snapshot" :: held 2.337s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.291s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.434s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1206637537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee3f3ef-9832-4a7e-b94c-ee1b31978b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf8a631e7754487bcff03efb25ee212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:06Z,use_quota=True,user_id='324c21a12ba44b5f8a37fcd16fd950b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Creating volume 7ee3f3ef-9832-4a7e-b94c-ee1b31978b45 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:06 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:12:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:06 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45 1073741824 Sep 28 16:12:06 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:06 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-fca7a730-8e68-43c3-b455-5df9080b6cd9 tempest-GroupsV314Test-25714432 None] Create group from source-group-9b2e3d72-227e-4ec1-bd86-7b0211181d75 completed successfully. Sep 28 16:12:07 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45 1073741824" returned: 0 in 0.649s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:07 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45 Sep 28 16:12:07 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:07 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45" returned: 0 in 0.324s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19725eba-2134-4403-80cd-9ff28953435a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ae5326-582e-4309-9c53-af4892a0f610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] Acquiring lock "cinder-quobyte-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:07 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Volume volume-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45 (7ee3f3ef-9832-4a7e-b94c-ee1b31978b45): created successfully Sep 28 16:12:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ae5326-582e-4309-9c53-af4892a0f610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Flow 'volume_create_manager' (d3ea37d7-f8d8-4c08-a9dc-41e94e11da27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f5352241-6aaa-41aa-a643-005c784f76dc tempest-VolumesTransfersV357Test-903759679 None] Created volume successfully. Sep 28 16:12:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] Lock "cinder-quobyte-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b" acquired by "delete_volume" :: waited 0.047s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:07 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc8bb58-ea5e-47bf-856f-abcedf95f963]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:07 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b Sep 28 16:12:07 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:08 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b" returned: 0 in 0.503s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:08 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b Sep 28 16:12:08 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:08 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b" returned: 0 in 0.393s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] Lock "cinder-quobyte-96d7449b-0aa0-4e22-a8c2-7c578ac96f5b" released by "delete_volume" :: held 0.974s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:08 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] Created reservations ['6118bc7e-c645-414a-b5ce-783527ecfc83'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:08 devstack cinder-volume[87087]: WARNING cinder.quota [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1676060097 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1676060097, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:12:08 devstack cinder-volume[87087]: WARNING cinder.quota [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1676060097 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1676060097, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:12:08 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] Created reservations ['21aae35e-7178-4d49-b390-cb603a522d18', 'cfa75135-6a7d-4308-b0a7-8b63420c370b', '5bc727b8-4a98-4b40-a7df-e8991dc2c876', 'fc61456b-a59c-4f75-ab25-98f7e37b71eb'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:09 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-df1e0b6b-b29d-4819-82dc-57a42f315b3b tempest-VolumesTransfersV357Test-504338402 None] Transfer volume completed successfully. Sep 28 16:12:09 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:12:09 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:09 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.421s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:09 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:09 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6a22933c-bee3-426f-b5d3-40898665c105 tempest-GroupsV314Test-25714432 None] Delete group completed successfully. Sep 28 16:12:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-60cbf064-06a3-4ace-9572-b6f9c3f6a94d tempest-GroupsV314Test-25714432 None] Acquiring lock "cinder-quobyte-cc3078a3-5be0-45a4-b39e-342f9470a859" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-60cbf064-06a3-4ace-9572-b6f9c3f6a94d tempest-GroupsV314Test-25714432 None] Lock "cinder-quobyte-cc3078a3-5be0-45a4-b39e-342f9470a859" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:09 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd13fa5-fcdf-4a3c-baa0-eab3f88e2554]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-60cbf064-06a3-4ace-9572-b6f9c3f6a94d tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:09 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859 Sep 28 16:12:09 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] Acquiring lock "cinder-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] Lock "cinder-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] Acquiring lock "cinder-quobyte-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] Lock "cinder-quobyte-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:09 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b0ec89-abe8-4636-b48c-46a170512791]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:10 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-60cbf064-06a3-4ace-9572-b6f9c3f6a94d tempest-GroupsV314Test-25714432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859" returned: 0 in 0.481s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-60cbf064-06a3-4ace-9572-b6f9c3f6a94d tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:10 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859 Sep 28 16:12:10 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:10 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45 Sep 28 16:12:10 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:10 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-60cbf064-06a3-4ace-9572-b6f9c3f6a94d tempest-GroupsV314Test-25714432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc3078a3-5be0-45a4-b39e-342f9470a859" returned: 0 in 0.343s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-60cbf064-06a3-4ace-9572-b6f9c3f6a94d tempest-GroupsV314Test-25714432 None] Lock "cinder-quobyte-cc3078a3-5be0-45a4-b39e-342f9470a859" released by "delete_volume" :: held 1.022s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:10 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45" returned: 0 in 0.634s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:10 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-60cbf064-06a3-4ace-9572-b6f9c3f6a94d tempest-GroupsV314Test-25714432 None] Created reservations ['3d112d5b-bfde-4d86-948f-a851188b17f7'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:10 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45 Sep 28 16:12:10 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:10 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-60cbf064-06a3-4ace-9572-b6f9c3f6a94d tempest-GroupsV314Test-25714432 None] Created reservations ['9229bd46-ebc0-47d4-bdb6-fcfb306fddf3', '6917af41-afa9-42a3-808a-14a7c394a5a8', '95b1d431-350d-43a8-b901-6f8bc3bd5084', 'd5385f3a-5ea1-4d61-9912-eb9fb9f1117b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-60cbf064-06a3-4ace-9572-b6f9c3f6a94d tempest-GroupsV314Test-25714432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-60cbf064-06a3-4ace-9572-b6f9c3f6a94d tempest-GroupsV314Test-25714432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-60cbf064-06a3-4ace-9572-b6f9c3f6a94d tempest-GroupsV314Test-25714432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-60cbf064-06a3-4ace-9572-b6f9c3f6a94d tempest-GroupsV314Test-25714432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-60cbf064-06a3-4ace-9572-b6f9c3f6a94d tempest-GroupsV314Test-25714432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-60cbf064-06a3-4ace-9572-b6f9c3f6a94d tempest-GroupsV314Test-25714432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:10 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:12:10 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:11 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45" returned: 0 in 0.412s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] Lock "cinder-quobyte-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45" released by "delete_volume" :: held 1.115s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:11 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] Created reservations ['41a606a1-f8e8-4895-92fa-e0b2c4a20b23', 'c3a46ee4-9e2e-49b4-a9a0-e52b3a4e4625', '8adb25b2-6314-46c9-81e0-f4099c78f9e9', 'a74bc72b-d1df-436f-91c0-6ca505f903e9'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:11 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:12:11 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:11 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-60cbf064-06a3-4ace-9572-b6f9c3f6a94d tempest-GroupsV314Test-25714432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.369s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:11 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-60cbf064-06a3-4ace-9572-b6f9c3f6a94d tempest-GroupsV314Test-25714432 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-60cbf064-06a3-4ace-9572-b6f9c3f6a94d tempest-GroupsV314Test-25714432 None] Delete group completed successfully. Sep 28 16:12:11 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.310s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:11 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] Deleted volume successfully. Sep 28 16:12:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c3c01793-2bce-471d-b799-548e72013969 tempest-VolumesTransfersV357Test-1331088208 None] Lock "cinder-7ee3f3ef-9832-4a7e-b94c-ee1b31978b45-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:12 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Flow 'volume_create_manager' (91d328e0-16c1-473d-b059-5d1bf1e391ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d54f5f4-052c-4453-a2d1-3de868bcb056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d54f5f4-052c-4453-a2d1-3de868bcb056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-120001732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d1a6d8-66e9-48f2-b509-344a0b649a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf8a631e7754487bcff03efb25ee212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:13Z,use_quota=True,user_id='324c21a12ba44b5f8a37fcd16fd950b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f879786-7a16-4ab1-986f-454bbfe512dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f879786-7a16-4ab1-986f-454bbfe512dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afa25dfe-1b5a-4a41-9c35-4bdaaa48894b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afa25dfe-1b5a-4a41-9c35-4bdaaa48894b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24d1a6d8-66e9-48f2-b509-344a0b649a2f', 'volume_name': 'volume-24d1a6d8-66e9-48f2-b509-344a0b649a2f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f156346b-5b75-48f2-82e6-ed9e73b5551e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f156346b-5b75-48f2-82e6-ed9e73b5551e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7157712a-453f-45a1-9fc2-2bdb5b52a3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:13 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Volume 24d1a6d8-66e9-48f2-b509-344a0b649a2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24d1a6d8-66e9-48f2-b509-344a0b649a2f', 'volume_size': 1} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-120001732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d1a6d8-66e9-48f2-b509-344a0b649a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf8a631e7754487bcff03efb25ee212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:13Z,use_quota=True,user_id='324c21a12ba44b5f8a37fcd16fd950b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Creating volume 24d1a6d8-66e9-48f2-b509-344a0b649a2f {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:13 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-24d1a6d8-66e9-48f2-b509-344a0b649a2f 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:13 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-24d1a6d8-66e9-48f2-b509-344a0b649a2f 1073741824 Sep 28 16:12:13 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:13 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-24d1a6d8-66e9-48f2-b509-344a0b649a2f 1073741824" returned: 0 in 0.830s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=176,cinder:SELECT=139,cinder:INSERT=43,cinder:DELETE=7 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:12:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-24d1a6d8-66e9-48f2-b509-344a0b649a2f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:14 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-24d1a6d8-66e9-48f2-b509-344a0b649a2f Sep 28 16:12:14 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:14 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-24d1a6d8-66e9-48f2-b509-344a0b649a2f" returned: 0 in 0.314s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7157712a-453f-45a1-9fc2-2bdb5b52a3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d1a6d8-66e9-48f2-b509-344a0b649a2f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdbe5aab-a5a8-4164-abca-301a8da4e146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:14 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Volume volume-24d1a6d8-66e9-48f2-b509-344a0b649a2f (24d1a6d8-66e9-48f2-b509-344a0b649a2f): created successfully Sep 28 16:12:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdbe5aab-a5a8-4164-abca-301a8da4e146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Flow 'volume_create_manager' (91d328e0-16c1-473d-b059-5d1bf1e391ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:14 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f7ddd9fe-35ef-4cad-aaec-754a1d1549cc tempest-VolumesTransfersV357Test-903759679 None] Created volume successfully. Sep 28 16:12:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] Acquiring lock "cinder-24d1a6d8-66e9-48f2-b509-344a0b649a2f-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] Lock "cinder-24d1a6d8-66e9-48f2-b509-344a0b649a2f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] Acquiring lock "cinder-quobyte-24d1a6d8-66e9-48f2-b509-344a0b649a2f" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] Lock "cinder-quobyte-24d1a6d8-66e9-48f2-b509-344a0b649a2f" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:15 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c130e783-edc6-4e37-8379-e6f2f962e244]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-24d1a6d8-66e9-48f2-b509-344a0b649a2f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:15 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-24d1a6d8-66e9-48f2-b509-344a0b649a2f Sep 28 16:12:15 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:16 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-24d1a6d8-66e9-48f2-b509-344a0b649a2f" returned: 0 in 0.544s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-24d1a6d8-66e9-48f2-b509-344a0b649a2f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:16 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-24d1a6d8-66e9-48f2-b509-344a0b649a2f Sep 28 16:12:16 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:16 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-24d1a6d8-66e9-48f2-b509-344a0b649a2f" returned: 0 in 0.348s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] Lock "cinder-quobyte-24d1a6d8-66e9-48f2-b509-344a0b649a2f" released by "delete_volume" :: held 0.980s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:16 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] Created reservations ['056fa440-fe7f-489f-8080-b00f56c3d5c5', '9fd1966e-010b-44df-966a-9a12ad2c105e', 'f460ee8e-d10d-439b-9487-e927531560fb', 'bbbb40c1-993f-461f-b29e-4bfd0baddb60'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:16 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:12:16 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:17 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.373s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:17 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:17 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] Deleted volume successfully. Sep 28 16:12:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ca6891d4-1f3f-42cd-9afe-33b6b701320a tempest-VolumesTransfersV357Test-1331088208 None] Lock "cinder-24d1a6d8-66e9-48f2-b509-344a0b649a2f-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:26 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=29,cinder:UPDATE=49,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:12:27 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=10,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Flow 'volume_create_manager' (c7265d75-2cf0-4917-a608-58b80d42385d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca07c626-0790-4ea3-a337-2cbe39a6d0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca07c626-0790-4ea3-a337-2cbe39a6d0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-524107477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d504e62a-4046-4b9e-b726-907b4f7b4796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88c2931bb9044eea9cff3d99d356514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:28Z,use_quota=True,user_id='61feffe687f64e84a7fcc1790cc6139c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b516204b-e43f-4f4c-8b8d-d6c591bb94e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b516204b-e43f-4f4c-8b8d-d6c591bb94e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f99f2ef-9481-466f-82bf-2d9f30ab7251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f99f2ef-9481-466f-82bf-2d9f30ab7251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd504e62a-4046-4b9e-b726-907b4f7b4796', 'volume_name': 'volume-d504e62a-4046-4b9e-b726-907b4f7b4796', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00473103-0886-4943-b601-64949c58fda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00473103-0886-4943-b601-64949c58fda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2386439-a097-4fc8-90bb-5cc2fa6d8890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:28 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Volume d504e62a-4046-4b9e-b726-907b4f7b4796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d504e62a-4046-4b9e-b726-907b4f7b4796', 'volume_size': 1} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-524107477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d504e62a-4046-4b9e-b726-907b4f7b4796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88c2931bb9044eea9cff3d99d356514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:28Z,use_quota=True,user_id='61feffe687f64e84a7fcc1790cc6139c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Creating volume d504e62a-4046-4b9e-b726-907b4f7b4796 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:28 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d504e62a-4046-4b9e-b726-907b4f7b4796 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:28 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d504e62a-4046-4b9e-b726-907b4f7b4796 1073741824 Sep 28 16:12:28 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:28 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d504e62a-4046-4b9e-b726-907b4f7b4796 1073741824" returned: 0 in 0.644s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d504e62a-4046-4b9e-b726-907b4f7b4796 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:29 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d504e62a-4046-4b9e-b726-907b4f7b4796 Sep 28 16:12:29 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:29 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d504e62a-4046-4b9e-b726-907b4f7b4796" returned: 0 in 0.384s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2386439-a097-4fc8-90bb-5cc2fa6d8890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d504e62a-4046-4b9e-b726-907b4f7b4796', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20081c9b-16b8-471f-96e1-21607918ab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:29 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Volume volume-d504e62a-4046-4b9e-b726-907b4f7b4796 (d504e62a-4046-4b9e-b726-907b4f7b4796): created successfully Sep 28 16:12:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20081c9b-16b8-471f-96e1-21607918ab58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Flow 'volume_create_manager' (c7265d75-2cf0-4917-a608-58b80d42385d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-53b86681-196e-448b-9dbe-22132285c8c2 tempest-VolumesNegativeTest-270495665 None] Created volume successfully. Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Flow 'volume_create_manager' (fe27c15c-7780-4c56-ac6b-3cb8866bbce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1160927d-808d-484c-8e3f-c95959e84d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1160927d-808d-484c-8e3f-c95959e84d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1896576336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c84b93-5d7e-4e6f-973c-030dac29aaff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c60c529f5d7646a29e825fbc9560c309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:33Z,use_quota=True,user_id='1ae77ab0092549568a888fbefc1c4d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59b47bc-ac4f-4730-99dd-2d6d6153beaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59b47bc-ac4f-4730-99dd-2d6d6153beaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5999306-9a4d-4940-8af8-486931bf09e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5999306-9a4d-4940-8af8-486931bf09e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97c84b93-5d7e-4e6f-973c-030dac29aaff', 'volume_name': 'volume-97c84b93-5d7e-4e6f-973c-030dac29aaff', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a5f3bf-9c22-4df0-bd45-996adf49e66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a5f3bf-9c22-4df0-bd45-996adf49e66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae6bafc-05ae-4ea7-a0d5-fe3255c2e334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:33 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Volume 97c84b93-5d7e-4e6f-973c-030dac29aaff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97c84b93-5d7e-4e6f-973c-030dac29aaff', 'volume_size': 1} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1896576336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c84b93-5d7e-4e6f-973c-030dac29aaff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c60c529f5d7646a29e825fbc9560c309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:33Z,use_quota=True,user_id='1ae77ab0092549568a888fbefc1c4d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Creating volume 97c84b93-5d7e-4e6f-973c-030dac29aaff {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:33 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:33 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff 1073741824 Sep 28 16:12:33 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:33 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff 1073741824" returned: 0 in 0.769s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:34 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff Sep 28 16:12:34 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:34 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff" returned: 0 in 0.403s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae6bafc-05ae-4ea7-a0d5-fe3255c2e334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97c84b93-5d7e-4e6f-973c-030dac29aaff', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d217d62d-af6f-42b4-88e0-a0466296f35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:34 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Volume volume-97c84b93-5d7e-4e6f-973c-030dac29aaff (97c84b93-5d7e-4e6f-973c-030dac29aaff): created successfully Sep 28 16:12:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d217d62d-af6f-42b4-88e0-a0466296f35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Flow 'volume_create_manager' (fe27c15c-7780-4c56-ac6b-3cb8866bbce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:34 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a99c3e26-adfd-4fb0-b044-b74b5dbdfbfb tempest-SnapshotsActionsTest-1738914373 None] Created volume successfully. Sep 28 16:12:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:12:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:35 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:12:35 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:35 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.370s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:12:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:12:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:12:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3a1517a1-572d-4420-8cde-5e5afa57598e tempest-SnapshotsActionsTest-1738914373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3a1517a1-572d-4420-8cde-5e5afa57598e tempest-SnapshotsActionsTest-1738914373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3a1517a1-572d-4420-8cde-5e5afa57598e tempest-SnapshotsActionsTest-1738914373 None] Creating offline snapshot 9ab8c78a-68d4-4236-bc2b-7df989f2e818 of volume 97c84b93-5d7e-4e6f-973c-030dac29aaff {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:12:35 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1438ae4-7c67-4882-8f90-d7578d61ac6c]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a1517a1-572d-4420-8cde-5e5afa57598e tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:35 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff Sep 28 16:12:35 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:36 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a1517a1-572d-4420-8cde-5e5afa57598e tempest-SnapshotsActionsTest-1738914373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff" returned: 0 in 0.465s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a1517a1-572d-4420-8cde-5e5afa57598e tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:36 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 1G Sep 28 16:12:36 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:36 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a1517a1-572d-4420-8cde-5e5afa57598e tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 1G" returned: 0 in 0.579s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a1517a1-572d-4420-8cde-5e5afa57598e tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c84b93-5d7e-4e6f-973c-030dac29aaff -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:36 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c84b93-5d7e-4e6f-973c-030dac29aaff -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 Sep 28 16:12:36 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:37 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a1517a1-572d-4420-8cde-5e5afa57598e tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c84b93-5d7e-4e6f-973c-030dac29aaff -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818" returned: 0 in 0.377s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:37 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-3a1517a1-572d-4420-8cde-5e5afa57598e tempest-SnapshotsActionsTest-1738914373 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 is being set with open permissions: ugo+rw Sep 28 16:12:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a1517a1-572d-4420-8cde-5e5afa57598e tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:37 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 Sep 28 16:12:37 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:37 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a1517a1-572d-4420-8cde-5e5afa57598e tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818" returned: 0 in 0.320s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a1517a1-572d-4420-8cde-5e5afa57598e tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:37 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.info Sep 28 16:12:37 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:37 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Flow 'volume_create_manager' (379dbc3a-fb83-434b-93d3-cfd64ade11e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438af157-83e5-411b-ad80-7b27b21cab2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:38 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438af157-83e5-411b-ad80-7b27b21cab2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1785365263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a79921-76a5-432f-afc6-e10cf1d2a4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0778d3c2b384aa5a04cdc79da614b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:38Z,use_quota=True,user_id='2c4156243db84d8482ba1f441488776e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(146deedd-1aad-4987-b9b8-d23723b4ae60),volume_type_id=146deedd-1aad-4987-b9b8-d23723b4ae60)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ca2c49-5429-4265-b468-dd73f6c23278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ca2c49-5429-4265-b468-dd73f6c23278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312e4c37-accb-45d2-b96d-c55c45d5807a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312e4c37-accb-45d2-b96d-c55c45d5807a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7a79921-76a5-432f-afc6-e10cf1d2a4f1', 'volume_name': 'volume-e7a79921-76a5-432f-afc6-e10cf1d2a4f1', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04972c81-9b2a-434f-bd59-65f439271821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04972c81-9b2a-434f-bd59-65f439271821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d29030-0f94-4ae3-a085-74cf37ea1ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:38 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Volume e7a79921-76a5-432f-afc6-e10cf1d2a4f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7a79921-76a5-432f-afc6-e10cf1d2a4f1', 'volume_size': 1} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a1517a1-572d-4420-8cde-5e5afa57598e tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.info" returned: 0 in 0.802s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:38 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-3a1517a1-572d-4420-8cde-5e5afa57598e tempest-SnapshotsActionsTest-1738914373 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.info is being set with open permissions: ugo+rw Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a1517a1-572d-4420-8cde-5e5afa57598e tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:38 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.info Sep 28 16:12:38 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:38 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a1517a1-572d-4420-8cde-5e5afa57598e tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.info" returned: 0 in 0.655s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3a1517a1-572d-4420-8cde-5e5afa57598e tempest-SnapshotsActionsTest-1738914373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.397s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.742s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1785365263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a79921-76a5-432f-afc6-e10cf1d2a4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0778d3c2b384aa5a04cdc79da614b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:38Z,use_quota=True,user_id='2c4156243db84d8482ba1f441488776e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(146deedd-1aad-4987-b9b8-d23723b4ae60),volume_type_id=146deedd-1aad-4987-b9b8-d23723b4ae60)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Creating volume e7a79921-76a5-432f-afc6-e10cf1d2a4f1 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:38 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:12:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e7a79921-76a5-432f-afc6-e10cf1d2a4f1 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:39 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Flow 'volume_create_manager' (76afc2b9-5c1b-465d-a5d7-dc100d852ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:39 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e7a79921-76a5-432f-afc6-e10cf1d2a4f1 1073741824 Sep 28 16:12:39 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c50978d-9d44-4288-998c-54af8e82b06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c50978d-9d44-4288-998c-54af8e82b06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-927710524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deafb66a-149e-4d2c-87bd-f78ff8c32688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0778d3c2b384aa5a04cdc79da614b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:39Z,use_quota=True,user_id='2c4156243db84d8482ba1f441488776e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f96346eb-6942-4afc-b5ae-aeb29c6aaf89),volume_type_id=f96346eb-6942-4afc-b5ae-aeb29c6aaf89)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb066ba8-221a-4c65-9954-d120546e27b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb066ba8-221a-4c65-9954-d120546e27b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50452521-8227-4e34-ad3c-d0d804cebbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50452521-8227-4e34-ad3c-d0d804cebbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deafb66a-149e-4d2c-87bd-f78ff8c32688', 'volume_name': 'volume-deafb66a-149e-4d2c-87bd-f78ff8c32688', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc40329a-038f-4301-b0c3-62548c8f7b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc40329a-038f-4301-b0c3-62548c8f7b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de6e8cf-229a-4f86-93eb-25a08dfb3c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:39 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Volume deafb66a-149e-4d2c-87bd-f78ff8c32688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deafb66a-149e-4d2c-87bd-f78ff8c32688', 'volume_size': 1} Sep 28 16:12:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3a1517a1-572d-4420-8cde-5e5afa57598e tempest-SnapshotsActionsTest-1738914373 None] Create snapshot completed successfully Sep 28 16:12:39 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e7a79921-76a5-432f-afc6-e10cf1d2a4f1 1073741824" returned: 0 in 0.810s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e7a79921-76a5-432f-afc6-e10cf1d2a4f1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:39 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e7a79921-76a5-432f-afc6-e10cf1d2a4f1 Sep 28 16:12:39 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:39 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Flow 'volume_create_manager' (b021d314-542f-4b29-9037-c74eb5e30817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3c86e1-844b-4a38-9883-d1695579462b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3c86e1-844b-4a38-9883-d1695579462b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1139646056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b7d553a-17a1-4b2d-b20f-a915618a760a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0778d3c2b384aa5a04cdc79da614b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:40Z,use_quota=True,user_id='2c4156243db84d8482ba1f441488776e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(536cee04-9e49-46bf-844d-021c6ca274e2),volume_type_id=536cee04-9e49-46bf-844d-021c6ca274e2)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cb2708-f2d6-4562-a10b-0d518e0ff972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cb2708-f2d6-4562-a10b-0d518e0ff972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff9f947-8d43-4040-8554-0a5faaab78a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:12:40 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e7a79921-76a5-432f-afc6-e10cf1d2a4f1" returned: 0 in 0.327s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.965s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-927710524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deafb66a-149e-4d2c-87bd-f78ff8c32688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0778d3c2b384aa5a04cdc79da614b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:39Z,use_quota=True,user_id='2c4156243db84d8482ba1f441488776e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f96346eb-6942-4afc-b5ae-aeb29c6aaf89),volume_type_id=f96346eb-6942-4afc-b5ae-aeb29c6aaf89)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Creating volume deafb66a-149e-4d2c-87bd-f78ff8c32688 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:40 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deafb66a-149e-4d2c-87bd-f78ff8c32688 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d29030-0f94-4ae3-a085-74cf37ea1ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a79921-76a5-432f-afc6-e10cf1d2a4f1', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1970307-d0cb-4ee0-a79f-1591eff5052b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:40 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deafb66a-149e-4d2c-87bd-f78ff8c32688 1073741824 Sep 28 16:12:40 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:40 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Volume volume-e7a79921-76a5-432f-afc6-e10cf1d2a4f1 (e7a79921-76a5-432f-afc6-e10cf1d2a4f1): created successfully Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1970307-d0cb-4ee0-a79f-1591eff5052b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Flow 'volume_create_manager' (379dbc3a-fb83-434b-93d3-cfd64ade11e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:40 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f126382d-7da0-4f11-9d4a-1dff2c40c7ea tempest-TestInstancesWithCinderVolumes-1989868134 None] Created volume successfully. Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff9f947-8d43-4040-8554-0a5faaab78a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b7d553a-17a1-4b2d-b20f-a915618a760a', 'volume_name': 'volume-0b7d553a-17a1-4b2d-b20f-a915618a760a', 'volume_size': 1, 'image_id': 'fb777ec7-c5b6-4e41-b0c2-a53ab5146bea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb777ec7-c5b6-4e41-b0c2-a53ab5146bea', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1283562502', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f0778d3c2b384aa5a04cdc79da614b20', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fb777ec7-c5b6-4e41-b0c2-a53ab5146bea', 'created_at': datetime.datetime(2026, 9, 28, 14, 12, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 12, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb777ec7-c5b6-4e41-b0c2-a53ab5146bea/file', 'properties': {}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9a8fa6-e77e-4b9e-8635-609d46adbdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9a8fa6-e77e-4b9e-8635-609d46adbdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d168258d-064b-4c44-a1cb-6a9115b96b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:40 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Volume 0b7d553a-17a1-4b2d-b20f-a915618a760a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b7d553a-17a1-4b2d-b20f-a915618a760a', 'volume_size': 1, 'image_id': 'fb777ec7-c5b6-4e41-b0c2-a53ab5146bea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb777ec7-c5b6-4e41-b0c2-a53ab5146bea', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1283562502', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f0778d3c2b384aa5a04cdc79da614b20', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fb777ec7-c5b6-4e41-b0c2-a53ab5146bea', 'created_at': datetime.datetime(2026, 9, 28, 14, 12, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 12, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb777ec7-c5b6-4e41-b0c2-a53ab5146bea/file', 'properties': {}}, 'image_service': } Sep 28 16:12:40 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Trying to clone 0b7d553a-17a1-4b2d-b20f-a915618a760a from image fb777ec7-c5b6-4e41-b0c2-a53ab5146bea at location (None, [{'url': 'file:///opt/stack/data/glance/images/fb777ec7-c5b6-4e41-b0c2-a53ab5146bea', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:12:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-71496e4d-e5ef-41f7-9861-1ba6de4fb7db tempest-SnapshotsActionsTest-1738914373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:41 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deafb66a-149e-4d2c-87bd-f78ff8c32688 1073741824" returned: 0 in 0.972s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deafb66a-149e-4d2c-87bd-f78ff8c32688 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:41 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deafb66a-149e-4d2c-87bd-f78ff8c32688 Sep 28 16:12:41 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:41 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deafb66a-149e-4d2c-87bd-f78ff8c32688" returned: 0 in 0.359s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-71496e4d-e5ef-41f7-9861-1ba6de4fb7db tempest-SnapshotsActionsTest-1738914373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.444s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de6e8cf-229a-4f86-93eb-25a08dfb3c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deafb66a-149e-4d2c-87bd-f78ff8c32688', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20df386-ec7c-41e6-855d-631de055f787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-71496e4d-e5ef-41f7-9861-1ba6de4fb7db tempest-SnapshotsActionsTest-1738914373 None] Creating offline snapshot c99ed251-23d3-4d02-a3c8-4d6b063b632f of volume 97c84b93-5d7e-4e6f-973c-030dac29aaff {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:12:41 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Volume volume-deafb66a-149e-4d2c-87bd-f78ff8c32688 (deafb66a-149e-4d2c-87bd-f78ff8c32688): created successfully Sep 28 16:12:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20df386-ec7c-41e6-855d-631de055f787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Flow 'volume_create_manager' (76afc2b9-5c1b-465d-a5d7-dc100d852ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:41 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d11022-82a0-4e76-9105-0e6df3668bd8]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71496e4d-e5ef-41f7-9861-1ba6de4fb7db tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:41 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3974e4b2-6b12-4900-acbd-3b826cf8e570 tempest-TestInstancesWithCinderVolumes-1989868134 None] Created volume successfully. Sep 28 16:12:41 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 Sep 28 16:12:41 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:42 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71496e4d-e5ef-41f7-9861-1ba6de4fb7db tempest-SnapshotsActionsTest-1738914373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818" returned: 0 in 0.625s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-71496e4d-e5ef-41f7-9861-1ba6de4fb7db tempest-SnapshotsActionsTest-1738914373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97c84b93-5d7e-4e6f-973c-030dac29aaff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:12:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71496e4d-e5ef-41f7-9861-1ba6de4fb7db tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:42 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f 1G Sep 28 16:12:42 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:43 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71496e4d-e5ef-41f7-9861-1ba6de4fb7db tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f 1G" returned: 0 in 0.700s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71496e4d-e5ef-41f7-9861-1ba6de4fb7db tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:43 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f Sep 28 16:12:43 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:43 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71496e4d-e5ef-41f7-9861-1ba6de4fb7db tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f" returned: 0 in 0.409s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:43 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-71496e4d-e5ef-41f7-9861-1ba6de4fb7db tempest-SnapshotsActionsTest-1738914373 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f is being set with open permissions: ugo+rw Sep 28 16:12:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71496e4d-e5ef-41f7-9861-1ba6de4fb7db tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:43 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f Sep 28 16:12:43 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:43 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71496e4d-e5ef-41f7-9861-1ba6de4fb7db tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f" returned: 0 in 0.383s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-71496e4d-e5ef-41f7-9861-1ba6de4fb7db tempest-SnapshotsActionsTest-1738914373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.310s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:43 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-71496e4d-e5ef-41f7-9861-1ba6de4fb7db tempest-SnapshotsActionsTest-1738914373 None] Create snapshot completed successfully Sep 28 16:12:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] Acquiring lock "cinder-c99ed251-23d3-4d02-a3c8-4d6b063b632f-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-c99ed251-23d3-4d02-a3c8-4d6b063b632f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] Acquiring lock "cinder-quobyte-97c84b93-5d7e-4e6f-973c-030dac29aaff" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-quobyte-97c84b93-5d7e-4e6f-973c-030dac29aaff" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] Acquiring lock "cinder-quobyte-c99ed251-23d3-4d02-a3c8-4d6b063b632f" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-quobyte-c99ed251-23d3-4d02-a3c8-4d6b063b632f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] Deleting offline snapshot c99ed251-23d3-4d02-a3c8-4d6b063b632f of volume 97c84b93-5d7e-4e6f-973c-030dac29aaff {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:12:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] snapshot_file for this snap is: volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:12:44 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[32882dcb-8598-4a3e-bbe8-13fad5300c3c]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:44 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f Sep 28 16:12:44 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:45 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f" returned: 0 in 0.488s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97c84b93-5d7e-4e6f-973c-030dac29aaff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:12:45 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe20357-5c10-4f70-81ae-56c9bfb5a3fa]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:45 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 Sep 28 16:12:45 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:45 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818" returned: 0 in 0.477s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97c84b93-5d7e-4e6f-973c-030dac29aaff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:12:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:45 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f Sep 28 16:12:45 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:45 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_rr9rnqcrdevstack@QuobyteHD, size 20.69 MB, duration 5.33 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:12:45 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Image download 20.69 MB at 3.88 MB/s Sep 28 16:12:45 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[447b215a-4248-4abb-b8ed-ab77065bbe49]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_rr9rnqcrdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:46 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f" returned: 0 in 0.425s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:46 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_rr9rnqcrdevstack@QuobyteHD Sep 28 16:12:46 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:46 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f Sep 28 16:12:46 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:46 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_rr9rnqcrdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:46 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Temporary image fb777ec7-c5b6-4e41-b0c2-a53ab5146bea is fetched for user 2c4156243db84d8482ba1f441488776e. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:12:46 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.c99ed251-23d3-4d02-a3c8-4d6b063b632f" returned: 0 in 0.290s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-quobyte-c99ed251-23d3-4d02-a3c8-4d6b063b632f" released by "_delete_snapshot" :: held 1.829s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-quobyte-97c84b93-5d7e-4e6f-973c-030dac29aaff" released by "delete_snapshot" :: held 1.868s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:46 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeed2b0-6375-4a13-9e28-5d6c097c4fad]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_rr9rnqcrdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:46 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] Created reservations ['01f106ed-56f7-42c8-8ddf-e38ed367e7d4', 'c36d72d3-76dc-47d7-a709-95b8b845071b', '32daef94-b38d-4638-9362-8f56397c75d8', 'a460a167-5311-4853-9577-d852cf33c752'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:46 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] Delete snapshot completed successfully. Sep 28 16:12:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4ec2d32-c7e8-4ad2-b5b6-bb6beaf17958 tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-c99ed251-23d3-4d02-a3c8-4d6b063b632f-delete_snapshot" released by "delete_snapshot" :: held 2.135s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:46 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_rr9rnqcrdevstack@QuobyteHD Sep 28 16:12:46 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:47 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_rr9rnqcrdevstack@QuobyteHD" returned: 0 in 0.560s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1139646056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b7d553a-17a1-4b2d-b20f-a915618a760a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0778d3c2b384aa5a04cdc79da614b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:40Z,use_quota=True,user_id='2c4156243db84d8482ba1f441488776e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(536cee04-9e49-46bf-844d-021c6ca274e2),volume_type_id=536cee04-9e49-46bf-844d-021c6ca274e2)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Creating volume 0b7d553a-17a1-4b2d-b20f-a915618a760a {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:47 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:12:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0b7d553a-17a1-4b2d-b20f-a915618a760a 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:47 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0b7d553a-17a1-4b2d-b20f-a915618a760a 1073741824 Sep 28 16:12:47 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9d334446-5ce5-46df-9b09-db0e270dc10e tempest-SnapshotsActionsTest-1738914373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:47 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0b7d553a-17a1-4b2d-b20f-a915618a760a 1073741824" returned: 0 in 0.572s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0b7d553a-17a1-4b2d-b20f-a915618a760a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:47 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0b7d553a-17a1-4b2d-b20f-a915618a760a Sep 28 16:12:47 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:48 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0b7d553a-17a1-4b2d-b20f-a915618a760a" returned: 0 in 0.346s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9d334446-5ce5-46df-9b09-db0e270dc10e tempest-SnapshotsActionsTest-1738914373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.639s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9d334446-5ce5-46df-9b09-db0e270dc10e tempest-SnapshotsActionsTest-1738914373 None] Creating offline snapshot 7522f78f-aea6-4853-acde-d7fd44532753 of volume 97c84b93-5d7e-4e6f-973c-030dac29aaff {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:12:48 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Attempting download of fb777ec7-c5b6-4e41-b0c2-a53ab5146bea ((None, [{'url': 'file:///opt/stack/data/glance/images/fb777ec7-c5b6-4e41-b0c2-a53ab5146bea', 'metadata': {}}])) to volume 0b7d553a-17a1-4b2d-b20f-a915618a760a. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:12:48 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb56262c-65ef-488e-9b33-461a446dbc55]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d334446-5ce5-46df-9b09-db0e270dc10e tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:48 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a22046d-280f-4eb9-9fc1-ba7092250424]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_e2uuj_lu {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:48 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 Sep 28 16:12:48 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:48 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_e2uuj_lu Sep 28 16:12:48 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:48 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_e2uuj_lu" returned: 0 in 0.399s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_e2uuj_lu {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:48 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d334446-5ce5-46df-9b09-db0e270dc10e tempest-SnapshotsActionsTest-1738914373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818" returned: 0 in 0.488s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9d334446-5ce5-46df-9b09-db0e270dc10e tempest-SnapshotsActionsTest-1738914373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97c84b93-5d7e-4e6f-973c-030dac29aaff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:12:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d334446-5ce5-46df-9b09-db0e270dc10e tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:48 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753 1G Sep 28 16:12:48 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:48 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_e2uuj_lu Sep 28 16:12:48 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:48 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_e2uuj_lu" returned: 1 in 0.362s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_e2uuj_lu' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:12:48 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1464fe-a705-4683-87e7-db0d8cddca98]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_rr9rnqcrdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:49 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_rr9rnqcrdevstack@QuobyteHD Sep 28 16:12:49 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:49 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d334446-5ce5-46df-9b09-db0e270dc10e tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753 1G" returned: 0 in 0.604s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d334446-5ce5-46df-9b09-db0e270dc10e tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:49 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753 Sep 28 16:12:49 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:49 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_rr9rnqcrdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:49 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] fb777ec7-c5b6-4e41-b0c2-a53ab5146bea was qcow2, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:12:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_rr9rnqcrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0b7d553a-17a1-4b2d-b20f-a915618a760a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:49 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_rr9rnqcrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0b7d553a-17a1-4b2d-b20f-a915618a760a Sep 28 16:12:49 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:49 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d334446-5ce5-46df-9b09-db0e270dc10e tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753" returned: 0 in 0.382s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:49 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-9d334446-5ce5-46df-9b09-db0e270dc10e tempest-SnapshotsActionsTest-1738914373 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753 is being set with open permissions: ugo+rw Sep 28 16:12:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d334446-5ce5-46df-9b09-db0e270dc10e tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:49 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753 Sep 28 16:12:49 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:49 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d334446-5ce5-46df-9b09-db0e270dc10e tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753" returned: 0 in 0.330s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9d334446-5ce5-46df-9b09-db0e270dc10e tempest-SnapshotsActionsTest-1738914373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:50 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9d334446-5ce5-46df-9b09-db0e270dc10e tempest-SnapshotsActionsTest-1738914373 None] Create snapshot completed successfully Sep 28 16:12:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] Acquiring lock "cinder-7522f78f-aea6-4853-acde-d7fd44532753-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-7522f78f-aea6-4853-acde-d7fd44532753-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] Acquiring lock "cinder-quobyte-97c84b93-5d7e-4e6f-973c-030dac29aaff" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-quobyte-97c84b93-5d7e-4e6f-973c-030dac29aaff" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] Acquiring lock "cinder-quobyte-7522f78f-aea6-4853-acde-d7fd44532753" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-quobyte-7522f78f-aea6-4853-acde-d7fd44532753" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] Deleting offline snapshot 7522f78f-aea6-4853-acde-d7fd44532753 of volume 97c84b93-5d7e-4e6f-973c-030dac29aaff {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:12:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] snapshot_file for this snap is: volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:12:50 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3432d0-e91e-4f9d-b387-8ef9bea6d1f5]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:50 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753 Sep 28 16:12:50 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:51 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753" returned: 0 in 0.479s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97c84b93-5d7e-4e6f-973c-030dac29aaff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:12:51 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca9c55a-dbf4-44a6-953a-2f9b68f07681]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:51 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 Sep 28 16:12:51 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:51 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_rr9rnqcrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0b7d553a-17a1-4b2d-b20f-a915618a760a" returned: 0 in 2.488s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:51 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fb777ec7-c5b6-4e41-b0c2-a53ab5146bea_rr9rnqcrdevstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0b7d553a-17a1-4b2d-b20f-a915618a760a {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:12:51 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Converted 112.00 MB image at 44.99 MB/s Sep 28 16:12:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0b7d553a-17a1-4b2d-b20f-a915618a760a 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:51 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0b7d553a-17a1-4b2d-b20f-a915618a760a 1G Sep 28 16:12:51 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:51 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818" returned: 0 in 0.532s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97c84b93-5d7e-4e6f-973c-030dac29aaff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:12:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:51 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753 Sep 28 16:12:51 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:52 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0b7d553a-17a1-4b2d-b20f-a915618a760a 1G" returned: 0 in 0.409s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:52 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Downloaded image fb777ec7-c5b6-4e41-b0c2-a53ab5146bea ((None, [{'url': 'file:///opt/stack/data/glance/images/fb777ec7-c5b6-4e41-b0c2-a53ab5146bea', 'metadata': {}}])) to volume 0b7d553a-17a1-4b2d-b20f-a915618a760a successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:12:52 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Temporary image fb777ec7-c5b6-4e41-b0c2-a53ab5146bea for user 2c4156243db84d8482ba1f441488776e is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:12:52 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Marking volume 0b7d553a-17a1-4b2d-b20f-a915618a760a as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:12:52 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Copying metadata from image fb777ec7-c5b6-4e41-b0c2-a53ab5146bea to 0b7d553a-17a1-4b2d-b20f-a915618a760a. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:12:52 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Creating volume glance metadata for volume 0b7d553a-17a1-4b2d-b20f-a915618a760a backed by image fb777ec7-c5b6-4e41-b0c2-a53ab5146bea with: {'image_id': 'fb777ec7-c5b6-4e41-b0c2-a53ab5146bea', 'image_name': 'tempest-scenario-img--1283562502', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:12:52 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753" returned: 0 in 0.492s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d168258d-064b-4c44-a1cb-6a9115b96b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b7d553a-17a1-4b2d-b20f-a915618a760a', 'volume_size': 1, 'image_id': 'fb777ec7-c5b6-4e41-b0c2-a53ab5146bea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb777ec7-c5b6-4e41-b0c2-a53ab5146bea', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1283562502', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f0778d3c2b384aa5a04cdc79da614b20', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fb777ec7-c5b6-4e41-b0c2-a53ab5146bea', 'created_at': datetime.datetime(2026, 9, 28, 14, 12, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 12, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb777ec7-c5b6-4e41-b0c2-a53ab5146bea/file', 'properties': {}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:52 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753 Sep 28 16:12:52 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc24a35f-7037-4c02-86e7-5175d069826f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:52 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Volume volume-0b7d553a-17a1-4b2d-b20f-a915618a760a (0b7d553a-17a1-4b2d-b20f-a915618a760a): created successfully Sep 28 16:12:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc24a35f-7037-4c02-86e7-5175d069826f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Flow 'volume_create_manager' (b021d314-542f-4b29-9037-c74eb5e30817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:52 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8dc164ed-a1a0-4db6-8841-87d152eff2fa tempest-TestInstancesWithCinderVolumes-1989868134 None] Created volume successfully. Sep 28 16:12:52 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.7522f78f-aea6-4853-acde-d7fd44532753" returned: 0 in 0.357s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-quobyte-7522f78f-aea6-4853-acde-d7fd44532753" released by "_delete_snapshot" :: held 2.022s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-quobyte-97c84b93-5d7e-4e6f-973c-030dac29aaff" released by "delete_snapshot" :: held 2.056s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:52 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] Created reservations ['e48d3f4b-49bd-4402-b93c-790c9a6e9907', '97c7ff96-bab0-4345-8bef-b3ce14fa0161', 'b0115895-5c30-4562-8506-3f8cb2073c4e', 'a65fff2c-1272-4d0a-8edd-d21fe44edadc'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:52 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] Delete snapshot completed successfully. Sep 28 16:12:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd5612a6-511c-404e-81cf-24c2b6cc940c tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-7522f78f-aea6-4853-acde-d7fd44532753-delete_snapshot" released by "delete_snapshot" :: held 2.282s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e4b4bae9-f85a-4861-b73e-b676acbb241d tempest-SnapshotsActionsTest-1738914373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e4b4bae9-f85a-4861-b73e-b676acbb241d tempest-SnapshotsActionsTest-1738914373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e4b4bae9-f85a-4861-b73e-b676acbb241d tempest-SnapshotsActionsTest-1738914373 None] Creating offline snapshot 99f0d37b-d48d-4df5-878a-9ac72558374a of volume 97c84b93-5d7e-4e6f-973c-030dac29aaff {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:12:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] Acquiring lock "cinder-d504e62a-4046-4b9e-b726-907b4f7b4796-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] Lock "cinder-d504e62a-4046-4b9e-b726-907b4f7b4796-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:54 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0acc116-08a1-4ec1-a0ba-582848c1a77c]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4b4bae9-f85a-4861-b73e-b676acbb241d tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] Acquiring lock "cinder-quobyte-d504e62a-4046-4b9e-b726-907b4f7b4796" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] Lock "cinder-quobyte-d504e62a-4046-4b9e-b726-907b4f7b4796" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:54 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[759462ba-8f8b-4763-bc85-32a54a60abb9]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d504e62a-4046-4b9e-b726-907b4f7b4796 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:54 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 Sep 28 16:12:54 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:54 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d504e62a-4046-4b9e-b726-907b4f7b4796 Sep 28 16:12:54 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:55 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4b4bae9-f85a-4861-b73e-b676acbb241d tempest-SnapshotsActionsTest-1738914373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818" returned: 0 in 0.523s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e4b4bae9-f85a-4861-b73e-b676acbb241d tempest-SnapshotsActionsTest-1738914373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97c84b93-5d7e-4e6f-973c-030dac29aaff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:12:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4b4bae9-f85a-4861-b73e-b676acbb241d tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:55 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a 1G Sep 28 16:12:55 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:55 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d504e62a-4046-4b9e-b726-907b4f7b4796" returned: 0 in 0.509s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d504e62a-4046-4b9e-b726-907b4f7b4796 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:55 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d504e62a-4046-4b9e-b726-907b4f7b4796 Sep 28 16:12:55 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:55 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d504e62a-4046-4b9e-b726-907b4f7b4796" returned: 0 in 0.377s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] Lock "cinder-quobyte-d504e62a-4046-4b9e-b726-907b4f7b4796" released by "delete_volume" :: held 0.955s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:55 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] Created reservations ['8768d48b-b834-4a68-9289-a3f5adb88747', '24d73dba-fa26-46cd-aa0c-6788587c8466', 'fa7e9141-834c-4c30-bcc0-748efcf735b0', 'd7541ca1-ef63-4fdd-ab5d-23b2d42de63e'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:55 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4b4bae9-f85a-4861-b73e-b676acbb241d tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a 1G" returned: 0 in 0.728s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4b4bae9-f85a-4861-b73e-b676acbb241d tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:55 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a Sep 28 16:12:55 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:55 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:12:55 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:56 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4b4bae9-f85a-4861-b73e-b676acbb241d tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a" returned: 0 in 0.400s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:56 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-e4b4bae9-f85a-4861-b73e-b676acbb241d tempest-SnapshotsActionsTest-1738914373 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a is being set with open permissions: ugo+rw Sep 28 16:12:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4b4bae9-f85a-4861-b73e-b676acbb241d tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:56 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a Sep 28 16:12:56 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:56 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.387s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:56 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:56 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] Deleted volume successfully. Sep 28 16:12:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-638aed65-5575-4d0b-af71-b45e3a1553af tempest-VolumesNegativeTest-270495665 None] Lock "cinder-d504e62a-4046-4b9e-b726-907b4f7b4796-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:56 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4b4bae9-f85a-4861-b73e-b676acbb241d tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a" returned: 0 in 0.328s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e4b4bae9-f85a-4861-b73e-b676acbb241d tempest-SnapshotsActionsTest-1738914373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:56 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e4b4bae9-f85a-4861-b73e-b676acbb241d tempest-SnapshotsActionsTest-1738914373 None] Create snapshot completed successfully Sep 28 16:12:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-6ca90417-e8ea-4bf1-80b5-b56fd12fa907 req-14aa1134-ce52-4f5e-bf93-2ceacf86750f tempest-TestInstancesWithCinderVolumes-1989868134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-6ca90417-e8ea-4bf1-80b5-b56fd12fa907 req-14aa1134-ce52-4f5e-bf93-2ceacf86750f tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-6ca90417-e8ea-4bf1-80b5-b56fd12fa907 req-14aa1134-ce52-4f5e-bf93-2ceacf86750f tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-6ca90417-e8ea-4bf1-80b5-b56fd12fa907 req-14aa1134-ce52-4f5e-bf93-2ceacf86750f tempest-TestInstancesWithCinderVolumes-1989868134 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-0b7d553a-17a1-4b2d-b20f-a915618a760a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3e01641-0eec-4e6e-81e3-f4148f0ab533', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:12:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-6ca90417-e8ea-4bf1-80b5-b56fd12fa907 req-14aa1134-ce52-4f5e-bf93-2ceacf86750f tempest-TestInstancesWithCinderVolumes-1989868134 None] attachment_update completed successfully. Sep 28 16:12:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] Acquiring lock "cinder-99f0d37b-d48d-4df5-878a-9ac72558374a-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-99f0d37b-d48d-4df5-878a-9ac72558374a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] Acquiring lock "cinder-quobyte-97c84b93-5d7e-4e6f-973c-030dac29aaff" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-quobyte-97c84b93-5d7e-4e6f-973c-030dac29aaff" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] Acquiring lock "cinder-quobyte-99f0d37b-d48d-4df5-878a-9ac72558374a" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-quobyte-99f0d37b-d48d-4df5-878a-9ac72558374a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] Deleting offline snapshot 99f0d37b-d48d-4df5-878a-9ac72558374a of volume 97c84b93-5d7e-4e6f-973c-030dac29aaff {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:12:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] snapshot_file for this snap is: volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:12:57 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a196f9b1-9f6e-4fc9-8d43-55714f3ee21d]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:58 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a Sep 28 16:12:58 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:58 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a" returned: 0 in 0.506s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97c84b93-5d7e-4e6f-973c-030dac29aaff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:12:58 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca999ea9-f848-4fee-bca3-8481457e7784]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:58 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 Sep 28 16:12:58 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:59 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818" returned: 0 in 0.551s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97c84b93-5d7e-4e6f-973c-030dac29aaff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:12:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:59 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a Sep 28 16:12:59 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:59 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a" returned: 0 in 0.553s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:59 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a Sep 28 16:12:59 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:59 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.99f0d37b-d48d-4df5-878a-9ac72558374a" returned: 0 in 0.327s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-quobyte-99f0d37b-d48d-4df5-878a-9ac72558374a" released by "_delete_snapshot" :: held 2.105s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-quobyte-97c84b93-5d7e-4e6f-973c-030dac29aaff" released by "delete_snapshot" :: held 2.147s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:00 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] Created reservations ['fe495a80-4fd3-4318-ac9a-8dd4034cfa17', 'fee19f0a-c757-4e2f-a699-96441e0660e4', '490d33c9-bd53-41d4-a02a-a62a018506a1', '80125bb1-17b9-4dd8-8667-1e96cc9311aa'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] Delete snapshot completed successfully. Sep 28 16:13:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c83b19b9-4062-493d-a1ac-ade33cbad99a tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-99f0d37b-d48d-4df5-878a-9ac72558374a-delete_snapshot" released by "delete_snapshot" :: held 2.422s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-59fbc5cf-2ac8-4e74-90c4-5161afe30940 tempest-SnapshotsActionsTest-1738914373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-59fbc5cf-2ac8-4e74-90c4-5161afe30940 tempest-SnapshotsActionsTest-1738914373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-59fbc5cf-2ac8-4e74-90c4-5161afe30940 tempest-SnapshotsActionsTest-1738914373 None] Creating offline snapshot 4b46e829-576f-42ae-b7e9-b20322f31092 of volume 97c84b93-5d7e-4e6f-973c-030dac29aaff {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:13:01 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baf35f9-6d63-4156-8204-b34e391a7aef]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-59fbc5cf-2ac8-4e74-90c4-5161afe30940 tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:02 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 Sep 28 16:13:02 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:02 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-59fbc5cf-2ac8-4e74-90c4-5161afe30940 tempest-SnapshotsActionsTest-1738914373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818" returned: 0 in 0.572s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-59fbc5cf-2ac8-4e74-90c4-5161afe30940 tempest-SnapshotsActionsTest-1738914373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97c84b93-5d7e-4e6f-973c-030dac29aaff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:13:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-59fbc5cf-2ac8-4e74-90c4-5161afe30940 tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:02 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092 1G Sep 28 16:13:02 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:03 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-59fbc5cf-2ac8-4e74-90c4-5161afe30940 tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092 1G" returned: 0 in 0.630s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-59fbc5cf-2ac8-4e74-90c4-5161afe30940 tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:03 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092 Sep 28 16:13:03 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:03 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-59fbc5cf-2ac8-4e74-90c4-5161afe30940 tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092" returned: 0 in 0.368s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:03 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-59fbc5cf-2ac8-4e74-90c4-5161afe30940 tempest-SnapshotsActionsTest-1738914373 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092 is being set with open permissions: ugo+rw Sep 28 16:13:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-59fbc5cf-2ac8-4e74-90c4-5161afe30940 tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:03 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092 Sep 28 16:13:03 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:03 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-59fbc5cf-2ac8-4e74-90c4-5161afe30940 tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092" returned: 0 in 0.480s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-59fbc5cf-2ac8-4e74-90c4-5161afe30940 tempest-SnapshotsActionsTest-1738914373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.313s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:04 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-59fbc5cf-2ac8-4e74-90c4-5161afe30940 tempest-SnapshotsActionsTest-1738914373 None] Create snapshot completed successfully Sep 28 16:13:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] Acquiring lock "cinder-4b46e829-576f-42ae-b7e9-b20322f31092-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-4b46e829-576f-42ae-b7e9-b20322f31092-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] Acquiring lock "cinder-quobyte-97c84b93-5d7e-4e6f-973c-030dac29aaff" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-quobyte-97c84b93-5d7e-4e6f-973c-030dac29aaff" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] Acquiring lock "cinder-quobyte-4b46e829-576f-42ae-b7e9-b20322f31092" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-quobyte-4b46e829-576f-42ae-b7e9-b20322f31092" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] Deleting offline snapshot 4b46e829-576f-42ae-b7e9-b20322f31092 of volume 97c84b93-5d7e-4e6f-973c-030dac29aaff {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:13:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] snapshot_file for this snap is: volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:13:05 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e894394-56a8-43ee-9217-332dfa80c9e2]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:05 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092 Sep 28 16:13:05 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:06 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092" returned: 0 in 0.859s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97c84b93-5d7e-4e6f-973c-030dac29aaff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:13:06 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[68df1877-b5a0-4094-acd1-1fca768d3362]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:06 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 Sep 28 16:13:06 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:06 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818" returned: 0 in 0.572s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97c84b93-5d7e-4e6f-973c-030dac29aaff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:13:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:06 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092 Sep 28 16:13:06 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:07 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092" returned: 0 in 0.580s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:07 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092 Sep 28 16:13:07 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:08 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.4b46e829-576f-42ae-b7e9-b20322f31092" returned: 0 in 0.658s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-quobyte-4b46e829-576f-42ae-b7e9-b20322f31092" released by "_delete_snapshot" :: held 2.841s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-quobyte-97c84b93-5d7e-4e6f-973c-030dac29aaff" released by "delete_snapshot" :: held 2.884s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:08 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] Created reservations ['dcb8654b-49bc-4b0f-a759-7ec8748d4732', '8c8a4d4e-bb05-4b37-ab0a-bbb321ee03cb', '71c0ccce-d430-41fe-912c-9fbbfab22f97', 'b8ecb641-c50e-4204-925f-f1c400607064'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:08 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] Delete snapshot completed successfully. Sep 28 16:13:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8eb02ba-e2af-4b3e-b6e4-07beec16516d tempest-SnapshotsActionsTest-1960016634 None] Lock "cinder-4b46e829-576f-42ae-b7e9-b20322f31092-delete_snapshot" released by "delete_snapshot" :: held 3.226s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] Acquiring lock "cinder-9ab8c78a-68d4-4236-bc2b-7df989f2e818-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] Lock "cinder-9ab8c78a-68d4-4236-bc2b-7df989f2e818-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] Acquiring lock "cinder-quobyte-97c84b93-5d7e-4e6f-973c-030dac29aaff" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] Lock "cinder-quobyte-97c84b93-5d7e-4e6f-973c-030dac29aaff" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] Acquiring lock "cinder-quobyte-9ab8c78a-68d4-4236-bc2b-7df989f2e818" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] Lock "cinder-quobyte-9ab8c78a-68d4-4236-bc2b-7df989f2e818" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] Deleting offline snapshot 9ab8c78a-68d4-4236-bc2b-7df989f2e818 of volume 97c84b93-5d7e-4e6f-973c-030dac29aaff {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:13:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] snapshot_file for this snap is: volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:13:09 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85ee999-c0ba-4ab4-af33-f4720c3fa5e8]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:09 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 Sep 28 16:13:09 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:10 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818" returned: 0 in 0.752s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97c84b93-5d7e-4e6f-973c-030dac29aaff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:13:10 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0359ee7f-8d09-4fb8-8fe0-fa9597266618]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:10 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff Sep 28 16:13:10 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:11 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff" returned: 0 in 0.817s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:11 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 Sep 28 16:13:11 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:11 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818" returned: 0 in 0.566s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:11 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818 Sep 28 16:13:11 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:12 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff.9ab8c78a-68d4-4236-bc2b-7df989f2e818" returned: 0 in 0.512s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] Lock "cinder-quobyte-9ab8c78a-68d4-4236-bc2b-7df989f2e818" released by "_delete_snapshot" :: held 2.861s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] Lock "cinder-quobyte-97c84b93-5d7e-4e6f-973c-030dac29aaff" released by "delete_snapshot" :: held 2.915s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:12 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] Created reservations ['da158a25-5482-4bb7-a4d3-5ea23fce5aff', 'b07d90dd-9ba1-4e57-a756-b9956a876e3d', 'b947ac96-c5bc-4a6a-b428-0db1e2bb44cf', '08ad72f3-e6f5-4546-a0ec-75af280219cc'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] Delete snapshot completed successfully. Sep 28 16:13:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-67c81fbe-3c36-4f16-ae5e-818965430e8c tempest-SnapshotsActionsTest-1738914373 None] Lock "cinder-9ab8c78a-68d4-4236-bc2b-7df989f2e818-delete_snapshot" released by "delete_snapshot" :: held 3.346s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] Acquiring lock "cinder-97c84b93-5d7e-4e6f-973c-030dac29aaff-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] Lock "cinder-97c84b93-5d7e-4e6f-973c-030dac29aaff-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] Acquiring lock "cinder-quobyte-97c84b93-5d7e-4e6f-973c-030dac29aaff" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] Lock "cinder-quobyte-97c84b93-5d7e-4e6f-973c-030dac29aaff" acquired by "delete_volume" :: waited 0.044s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:14 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c915956-fb1f-4e77-9909-f663620d5665]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:14 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff Sep 28 16:13:14 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:15 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff" returned: 0 in 0.939s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:15 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff Sep 28 16:13:15 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:16 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97c84b93-5d7e-4e6f-973c-030dac29aaff" returned: 0 in 0.776s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] Lock "cinder-quobyte-97c84b93-5d7e-4e6f-973c-030dac29aaff" released by "delete_volume" :: held 1.859s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:16 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] Created reservations ['77b10f90-0b96-461d-b4ef-b55b08faa34a', 'a1f0f7d3-4dfa-4271-8088-947ca8eb06d2', '1ca9793c-90a0-41a6-a895-3302aff7d799', 'ace62232-1fa7-4582-9452-80c2e4a6c957'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:16 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:13:16 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:17 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.740s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:17 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:17 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] Deleted volume successfully. Sep 28 16:13:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-96892ff8-5951-4d74-b5fe-57be729cb75e tempest-SnapshotsActionsTest-1738914373 None] Lock "cinder-97c84b93-5d7e-4e6f-973c-030dac29aaff-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:26 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=72,cinder:UPDATE=66,cinder:DELETE=6,cinder:INSERT=23 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:13:27 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=66,cinder:UPDATE=68,cinder:INSERT=20,cinder:DELETE=6 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:13:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:13:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:35 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:13:35 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:35 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.393s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:13:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:13:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:13:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-6fdfc6df-48d7-4831-8c6a-933972f8bd3a req-a965fc70-db07-44f5-9f42-8be2e12a2340 tempest-TestInstancesWithCinderVolumes-1989868134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-6fdfc6df-48d7-4831-8c6a-933972f8bd3a req-a965fc70-db07-44f5-9f42-8be2e12a2340 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-6fdfc6df-48d7-4831-8c6a-933972f8bd3a req-a965fc70-db07-44f5-9f42-8be2e12a2340 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-6fdfc6df-48d7-4831-8c6a-933972f8bd3a req-a965fc70-db07-44f5-9f42-8be2e12a2340 tempest-TestInstancesWithCinderVolumes-1989868134 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-e7a79921-76a5-432f-afc6-e10cf1d2a4f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9020e75f-e0e0-4982-a630-cb971da78748', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:13:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-6fdfc6df-48d7-4831-8c6a-933972f8bd3a req-a965fc70-db07-44f5-9f42-8be2e12a2340 tempest-TestInstancesWithCinderVolumes-1989868134 None] attachment_update completed successfully. Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Flow 'volume_create_manager' (bcd9bd74-f213-46a7-90da-1c67593f3878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17fb1e8b-b5ab-4125-9ea7-bb303b7860d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17fb1e8b-b5ab-4125-9ea7-bb303b7860d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1284253522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17363321-52fd-475d-8864-83e73af80655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70bb34282b21490fa6ce0803fe17515e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:38Z,use_quota=True,user_id='1e69cb41353b4ac08c96b05d931b4d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc11a9a-6693-4ab8-b887-be308865d74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc11a9a-6693-4ab8-b887-be308865d74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439b5db0-16ef-40f3-acd8-ff3715e3628c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439b5db0-16ef-40f3-acd8-ff3715e3628c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17363321-52fd-475d-8864-83e73af80655', 'volume_name': 'volume-17363321-52fd-475d-8864-83e73af80655', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109f6539-8647-4700-8cb4-62c811904be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109f6539-8647-4700-8cb4-62c811904be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17f0561-473d-4c61-80e9-4736e54a36d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:37 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Volume 17363321-52fd-475d-8864-83e73af80655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17363321-52fd-475d-8864-83e73af80655', 'volume_size': 1} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1284253522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17363321-52fd-475d-8864-83e73af80655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70bb34282b21490fa6ce0803fe17515e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:38Z,use_quota=True,user_id='1e69cb41353b4ac08c96b05d931b4d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Creating volume 17363321-52fd-475d-8864-83e73af80655 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:13:37 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:13:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:37 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655 1073741824 Sep 28 16:13:37 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:38 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655 1073741824" returned: 0 in 0.895s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:38 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655 Sep 28 16:13:38 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:39 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655" returned: 0 in 0.483s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:13:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17f0561-473d-4c61-80e9-4736e54a36d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17363321-52fd-475d-8864-83e73af80655', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068f15ba-aef0-4abc-91fe-5d6f1d19f8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:39 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Volume volume-17363321-52fd-475d-8864-83e73af80655 (17363321-52fd-475d-8864-83e73af80655): created successfully Sep 28 16:13:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068f15ba-aef0-4abc-91fe-5d6f1d19f8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Flow 'volume_create_manager' (bcd9bd74-f213-46a7-90da-1c67593f3878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-42613e0f-4195-4062-9e4a-46eafa98ea89 tempest-TestStampPattern-1714218360 None] Created volume successfully. Sep 28 16:13:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-1ca2aca6-d999-4a08-a81f-ac14f8ebadda req-b70f6965-6e1e-4ce4-be49-d128f8657d1e tempest-TestInstancesWithCinderVolumes-1989868134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-1ca2aca6-d999-4a08-a81f-ac14f8ebadda req-b70f6965-6e1e-4ce4-be49-d128f8657d1e tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-1ca2aca6-d999-4a08-a81f-ac14f8ebadda req-b70f6965-6e1e-4ce4-be49-d128f8657d1e tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-1ca2aca6-d999-4a08-a81f-ac14f8ebadda req-b70f6965-6e1e-4ce4-be49-d128f8657d1e tempest-TestInstancesWithCinderVolumes-1989868134 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-deafb66a-149e-4d2c-87bd-f78ff8c32688', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0163718-e833-457f-b8dd-061d2a8c3b84', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:13:40 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-1ca2aca6-d999-4a08-a81f-ac14f8ebadda req-b70f6965-6e1e-4ce4-be49-d128f8657d1e tempest-TestInstancesWithCinderVolumes-1989868134 None] attachment_update completed successfully. Sep 28 16:13:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-755fc099-6fe6-4a33-a915-89a6aa6fa1fe req-b075b3b5-477b-4c1c-9f2a-8fc7edbff0e1 tempest-TestInstancesWithCinderVolumes-1989868134 None] Terminate volume connection completed successfully. Sep 28 16:13:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-755fc099-6fe6-4a33-a915-89a6aa6fa1fe req-b075b3b5-477b-4c1c-9f2a-8fc7edbff0e1 tempest-TestInstancesWithCinderVolumes-1989868134 None] Deleting attachment 9020e75f-e0e0-4982-a630-cb971da78748. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:13:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] Acquiring lock "cinder-e7a79921-76a5-432f-afc6-e10cf1d2a4f1-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "cinder-e7a79921-76a5-432f-afc6-e10cf1d2a4f1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] Acquiring lock "cinder-quobyte-e7a79921-76a5-432f-afc6-e10cf1d2a4f1" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "cinder-quobyte-e7a79921-76a5-432f-afc6-e10cf1d2a4f1" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:48 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b513c68-1b89-4382-b1e3-3073e95bf991]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e7a79921-76a5-432f-afc6-e10cf1d2a4f1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:48 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e7a79921-76a5-432f-afc6-e10cf1d2a4f1 Sep 28 16:13:48 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:49 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e7a79921-76a5-432f-afc6-e10cf1d2a4f1" returned: 0 in 0.645s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e7a79921-76a5-432f-afc6-e10cf1d2a4f1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:49 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e7a79921-76a5-432f-afc6-e10cf1d2a4f1 Sep 28 16:13:49 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:49 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e7a79921-76a5-432f-afc6-e10cf1d2a4f1" returned: 0 in 0.406s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "cinder-quobyte-e7a79921-76a5-432f-afc6-e10cf1d2a4f1" released by "delete_volume" :: held 1.142s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:49 devstack cinder-volume[87087]: WARNING cinder.quota [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-891871169-2106313560 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-891871169-2106313560, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:13:49 devstack cinder-volume[87087]: WARNING cinder.quota [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-891871169-2106313560 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-891871169-2106313560, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:13:49 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] Created reservations ['5f5f176a-3642-4d13-8664-319c7c9a6d96', '0211d0fd-2864-43c5-8c07-fe9bad7453ef', '363b3e32-16d5-4f7f-8ec4-4e36a2fa18a9', 'a77a65e2-fed7-4301-a1b4-91d8522d028a'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:49 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:13:49 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:50 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.483s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:50 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:50 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] Deleted volume successfully. Sep 28 16:13:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7488d338-8efd-4e4c-935c-5847f60880f3 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "cinder-e7a79921-76a5-432f-afc6-e10cf1d2a4f1-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:54 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-75c77346-d232-4686-83d0-717fc700c500 req-fb18a26e-a7fe-4d5c-b4f3-bb1ef6e05f02 tempest-TestInstancesWithCinderVolumes-1989868134 None] Terminate volume connection completed successfully. Sep 28 16:13:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-75c77346-d232-4686-83d0-717fc700c500 req-fb18a26e-a7fe-4d5c-b4f3-bb1ef6e05f02 tempest-TestInstancesWithCinderVolumes-1989868134 None] Deleting attachment f0163718-e833-457f-b8dd-061d2a8c3b84. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:13:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] Acquiring lock "cinder-deafb66a-149e-4d2c-87bd-f78ff8c32688-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "cinder-deafb66a-149e-4d2c-87bd-f78ff8c32688-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] Acquiring lock "cinder-quobyte-deafb66a-149e-4d2c-87bd-f78ff8c32688" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "cinder-quobyte-deafb66a-149e-4d2c-87bd-f78ff8c32688" acquired by "delete_volume" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:56 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae09b8c-d9d2-402c-971c-84bfd9f24557]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deafb66a-149e-4d2c-87bd-f78ff8c32688 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:56 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deafb66a-149e-4d2c-87bd-f78ff8c32688 Sep 28 16:13:56 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:56 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deafb66a-149e-4d2c-87bd-f78ff8c32688" returned: 0 in 0.601s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deafb66a-149e-4d2c-87bd-f78ff8c32688 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:56 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deafb66a-149e-4d2c-87bd-f78ff8c32688 Sep 28 16:13:56 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:57 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-deafb66a-149e-4d2c-87bd-f78ff8c32688" returned: 0 in 0.612s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "cinder-quobyte-deafb66a-149e-4d2c-87bd-f78ff8c32688" released by "delete_volume" :: held 1.321s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:57 devstack cinder-volume[87087]: WARNING cinder.quota [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1635485215-1571178068 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1635485215-1571178068, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:13:57 devstack cinder-volume[87087]: WARNING cinder.quota [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1635485215-1571178068 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1635485215-1571178068, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:13:57 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] Created reservations ['710025b4-53a9-4b21-92ad-a5f27c613607', '4bad336f-e0c1-41dc-a2d8-dd71aa79a068', 'f8c1020e-9de6-4554-9245-7032fcb1e5ea', 'a4a2f3bb-4a43-4929-ad4d-981d9d83699d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:57 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:13:57 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:58 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.409s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:58 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] Deleted volume successfully. Sep 28 16:13:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-305f7e32-743f-48d5-9bf1-3bab46390136 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "cinder-deafb66a-149e-4d2c-87bd-f78ff8c32688-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:06 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-e56eb42e-0199-44be-b1e9-5bb6167c3e75 req-0ad9ea77-d2b6-4cd7-aa24-1651e3411064 tempest-TestInstancesWithCinderVolumes-1989868134 None] Terminate volume connection completed successfully. Sep 28 16:14:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-e56eb42e-0199-44be-b1e9-5bb6167c3e75 req-0ad9ea77-d2b6-4cd7-aa24-1651e3411064 tempest-TestInstancesWithCinderVolumes-1989868134 None] Deleting attachment e3e01641-0eec-4e6e-81e3-f4148f0ab533. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:14:07 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=29,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:14:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] Acquiring lock "cinder-0b7d553a-17a1-4b2d-b20f-a915618a760a-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "cinder-0b7d553a-17a1-4b2d-b20f-a915618a760a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] Acquiring lock "cinder-quobyte-0b7d553a-17a1-4b2d-b20f-a915618a760a" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "cinder-quobyte-0b7d553a-17a1-4b2d-b20f-a915618a760a" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:08 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0896ace9-6ec7-44f1-926a-51acc47cfa48]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0b7d553a-17a1-4b2d-b20f-a915618a760a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:08 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0b7d553a-17a1-4b2d-b20f-a915618a760a Sep 28 16:14:08 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:09 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0b7d553a-17a1-4b2d-b20f-a915618a760a" returned: 0 in 0.511s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0b7d553a-17a1-4b2d-b20f-a915618a760a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:09 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0b7d553a-17a1-4b2d-b20f-a915618a760a Sep 28 16:14:09 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:09 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0b7d553a-17a1-4b2d-b20f-a915618a760a" returned: 0 in 0.302s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "cinder-quobyte-0b7d553a-17a1-4b2d-b20f-a915618a760a" released by "delete_volume" :: held 0.861s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:09 devstack cinder-volume[87087]: WARNING cinder.quota [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1277202331-985564314 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1277202331-985564314, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:14:09 devstack cinder-volume[87087]: WARNING cinder.quota [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1277202331-985564314 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1277202331-985564314, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:14:09 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] Created reservations ['6453d92b-adcb-41d0-9378-b92ea5718f66', '3b929f81-3868-4d7d-9a1d-08935b60a216', 'e943a7b3-f8cf-4c8a-bee2-06885c0b9dbe', '2cf985c6-9faa-4f68-af18-a16739455a40'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:09 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:14:09 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:10 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.357s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:10 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] Deleted volume successfully. Sep 28 16:14:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-76bda734-af36-4079-9a02-14cdd0d64327 tempest-TestInstancesWithCinderVolumes-1989868134 None] Lock "cinder-0b7d553a-17a1-4b2d-b20f-a915618a760a-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Flow 'volume_create_manager' (0be65196-fe43-48dd-93de-c9cbfb73ac52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4ca98c-bc7f-4d5f-bae2-f87e9f03f965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4ca98c-bc7f-4d5f-bae2-f87e9f03f965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1599099871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0beaee-0da3-463b-a418-92a982ac287b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88cd7e87f30646ef95853bf630a652f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:16Z,use_quota=True,user_id='5236815be4ff4e74b783d74808604020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d904b8a1-e040-47e4-b0c6-792555fba3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d904b8a1-e040-47e4-b0c6-792555fba3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77139deb-c3fe-4874-a4aa-0f0a1204d929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77139deb-c3fe-4874-a4aa-0f0a1204d929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc0beaee-0da3-463b-a418-92a982ac287b', 'volume_name': 'volume-cc0beaee-0da3-463b-a418-92a982ac287b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb43610c-2a4c-4c29-a6bd-355a87a7bda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb43610c-2a4c-4c29-a6bd-355a87a7bda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27137fae-f3c3-4d31-8d2b-5e224a0a88fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:16 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Volume cc0beaee-0da3-463b-a418-92a982ac287b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc0beaee-0da3-463b-a418-92a982ac287b', 'volume_size': 1} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1599099871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0beaee-0da3-463b-a418-92a982ac287b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88cd7e87f30646ef95853bf630a652f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:16Z,use_quota=True,user_id='5236815be4ff4e74b783d74808604020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Creating volume cc0beaee-0da3-463b-a418-92a982ac287b {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:14:16 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:14:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc0beaee-0da3-463b-a418-92a982ac287b 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:16 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc0beaee-0da3-463b-a418-92a982ac287b 1073741824 Sep 28 16:14:16 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:17 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc0beaee-0da3-463b-a418-92a982ac287b 1073741824" returned: 0 in 0.916s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc0beaee-0da3-463b-a418-92a982ac287b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:17 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc0beaee-0da3-463b-a418-92a982ac287b Sep 28 16:14:17 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:18 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc0beaee-0da3-463b-a418-92a982ac287b" returned: 0 in 0.447s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:14:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27137fae-f3c3-4d31-8d2b-5e224a0a88fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc0beaee-0da3-463b-a418-92a982ac287b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1f2dd02-375b-4a78-af00-9ae98b3724c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:18 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Volume volume-cc0beaee-0da3-463b-a418-92a982ac287b (cc0beaee-0da3-463b-a418-92a982ac287b): created successfully Sep 28 16:14:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1f2dd02-375b-4a78-af00-9ae98b3724c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Flow 'volume_create_manager' (0be65196-fe43-48dd-93de-c9cbfb73ac52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:18 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7e82fd85-811f-4496-958d-8a990a8a836d tempest-VolumesActionsTest-592197276 None] Created volume successfully. Sep 28 16:14:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0c316b85-ac7c-4963-bb0e-3a0d4153c49a tempest-VolumesActionsTest-592197276 None] Acquiring lock "cinder-cc0beaee-0da3-463b-a418-92a982ac287b" by "attach_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0c316b85-ac7c-4963-bb0e-3a0d4153c49a tempest-VolumesActionsTest-592197276 None] Lock "cinder-cc0beaee-0da3-463b-a418-92a982ac287b" acquired by "attach_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:18 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0c316b85-ac7c-4963-bb0e-3a0d4153c49a tempest-VolumesActionsTest-592197276 None] Attaching volume cc0beaee-0da3-463b-a418-92a982ac287b to instance 3410f009-95b1-45b0-ae9d-765c05e133cc at mountpoint /dev/vdb on host None. Sep 28 16:14:18 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0c316b85-ac7c-4963-bb0e-3a0d4153c49a tempest-VolumesActionsTest-592197276 None] Attach volume completed successfully. Sep 28 16:14:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0c316b85-ac7c-4963-bb0e-3a0d4153c49a tempest-VolumesActionsTest-592197276 None] Lock "cinder-cc0beaee-0da3-463b-a418-92a982ac287b" released by "attach_volume" :: held 0.122s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-395cab65-9521-44d0-b7ae-d70433921c06 tempest-VolumesActionsTest-1072265092 None] Terminate volume connection completed successfully. Sep 28 16:14:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-395cab65-9521-44d0-b7ae-d70433921c06 tempest-VolumesActionsTest-1072265092 None] Acquiring lock "cinder-cc0beaee-0da3-463b-a418-92a982ac287b-detach_volume" by "detach_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-395cab65-9521-44d0-b7ae-d70433921c06 tempest-VolumesActionsTest-1072265092 None] Lock "cinder-cc0beaee-0da3-463b-a418-92a982ac287b-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-395cab65-9521-44d0-b7ae-d70433921c06 tempest-VolumesActionsTest-1072265092 None] Detaching volume cc0beaee-0da3-463b-a418-92a982ac287b from instance 3410f009-95b1-45b0-ae9d-765c05e133cc. Sep 28 16:14:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-395cab65-9521-44d0-b7ae-d70433921c06 tempest-VolumesActionsTest-1072265092 None] Detach volume completed successfully. Sep 28 16:14:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-395cab65-9521-44d0-b7ae-d70433921c06 tempest-VolumesActionsTest-1072265092 None] Lock "cinder-cc0beaee-0da3-463b-a418-92a982ac287b-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ae0b81bb-e832-4a0a-a4c8-3966a3470c77 tempest-VolumesActionsTest-592197276 None] Acquiring lock "cinder-cc0beaee-0da3-463b-a418-92a982ac287b-detach_volume" by "detach_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ae0b81bb-e832-4a0a-a4c8-3966a3470c77 tempest-VolumesActionsTest-592197276 None] Lock "cinder-cc0beaee-0da3-463b-a418-92a982ac287b-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ae0b81bb-e832-4a0a-a4c8-3966a3470c77 tempest-VolumesActionsTest-592197276 None] Volume detach called, but volume not attached. Sep 28 16:14:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ae0b81bb-e832-4a0a-a4c8-3966a3470c77 tempest-VolumesActionsTest-592197276 None] Lock "cinder-cc0beaee-0da3-463b-a418-92a982ac287b-detach_volume" released by "detach_volume" :: held 0.027s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] Acquiring lock "cinder-cc0beaee-0da3-463b-a418-92a982ac287b-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] Lock "cinder-cc0beaee-0da3-463b-a418-92a982ac287b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] Acquiring lock "cinder-quobyte-cc0beaee-0da3-463b-a418-92a982ac287b" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] Lock "cinder-quobyte-cc0beaee-0da3-463b-a418-92a982ac287b" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b49b3f-43d8-442b-9176-46987f0d3f66]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc0beaee-0da3-463b-a418-92a982ac287b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:20 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc0beaee-0da3-463b-a418-92a982ac287b Sep 28 16:14:20 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:20 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc0beaee-0da3-463b-a418-92a982ac287b" returned: 0 in 0.452s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc0beaee-0da3-463b-a418-92a982ac287b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:20 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc0beaee-0da3-463b-a418-92a982ac287b Sep 28 16:14:20 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:20 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cc0beaee-0da3-463b-a418-92a982ac287b" returned: 0 in 0.334s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] Lock "cinder-quobyte-cc0beaee-0da3-463b-a418-92a982ac287b" released by "delete_volume" :: held 0.849s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:21 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] Created reservations ['5e1e49ad-b53f-4e69-b18a-19acbff7fef5', '3cce35e0-66ca-46ce-87f3-80467c4c04bb', '23da8946-e651-49f8-8988-575751374d1c', 'f133bb52-3668-4489-8e36-8e4d7d4f4a7b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:21 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:14:21 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:21 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.480s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:21 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] Deleted volume successfully. Sep 28 16:14:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68230bca-900e-4694-9c54-e1659c8a7220 tempest-VolumesActionsTest-592197276 None] Lock "cinder-cc0beaee-0da3-463b-a418-92a982ac287b-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-188d8273-5e8d-4af2-99fb-e8c00858a427 req-eaf81822-dddb-47cf-8d2e-32b824dccae0 tempest-TestStampPattern-1714218360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-188d8273-5e8d-4af2-99fb-e8c00858a427 req-eaf81822-dddb-47cf-8d2e-32b824dccae0 tempest-TestStampPattern-1714218360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-188d8273-5e8d-4af2-99fb-e8c00858a427 req-eaf81822-dddb-47cf-8d2e-32b824dccae0 tempest-TestStampPattern-1714218360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-188d8273-5e8d-4af2-99fb-e8c00858a427 req-eaf81822-dddb-47cf-8d2e-32b824dccae0 tempest-TestStampPattern-1714218360 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-17363321-52fd-475d-8864-83e73af80655', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a61ef92d-75b2-46d8-a998-c896fae37edc', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:14:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-188d8273-5e8d-4af2-99fb-e8c00858a427 req-eaf81822-dddb-47cf-8d2e-32b824dccae0 tempest-TestStampPattern-1714218360 None] attachment_update completed successfully. Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Flow 'volume_create_manager' (10482da9-47d3-4527-bad1-eaa41bb79dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bed69ef-c3ad-46d0-9943-7a99ab3c8870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bed69ef-c3ad-46d0-9943-7a99ab3c8870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1277597287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=461b2bcb-2fbf-4661-b2d5-66d0156fcc34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88cd7e87f30646ef95853bf630a652f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:26Z,use_quota=True,user_id='5236815be4ff4e74b783d74808604020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd95764a-cc6d-42ac-8fa7-d6a0d922a28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd95764a-cc6d-42ac-8fa7-d6a0d922a28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e8c58d-e7ac-40ba-b4e4-b738a8ab999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e8c58d-e7ac-40ba-b4e4-b738a8ab999d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '461b2bcb-2fbf-4661-b2d5-66d0156fcc34', 'volume_name': 'volume-461b2bcb-2fbf-4661-b2d5-66d0156fcc34', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc399364-e244-4714-bef2-b2b288e591d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc399364-e244-4714-bef2-b2b288e591d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e356b9-3412-4005-8eda-4a20897c7154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:25 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Volume 461b2bcb-2fbf-4661-b2d5-66d0156fcc34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-461b2bcb-2fbf-4661-b2d5-66d0156fcc34', 'volume_size': 1} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1277597287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=461b2bcb-2fbf-4661-b2d5-66d0156fcc34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88cd7e87f30646ef95853bf630a652f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:26Z,use_quota=True,user_id='5236815be4ff4e74b783d74808604020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Creating volume 461b2bcb-2fbf-4661-b2d5-66d0156fcc34 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:14:25 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:14:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-461b2bcb-2fbf-4661-b2d5-66d0156fcc34 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:25 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-461b2bcb-2fbf-4661-b2d5-66d0156fcc34 1073741824 Sep 28 16:14:25 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:26 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-461b2bcb-2fbf-4661-b2d5-66d0156fcc34 1073741824" returned: 0 in 0.610s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:26 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=57,cinder:UPDATE=45,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:14:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-461b2bcb-2fbf-4661-b2d5-66d0156fcc34 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:26 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-461b2bcb-2fbf-4661-b2d5-66d0156fcc34 Sep 28 16:14:26 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:26 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-461b2bcb-2fbf-4661-b2d5-66d0156fcc34" returned: 0 in 0.335s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:14:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e356b9-3412-4005-8eda-4a20897c7154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-461b2bcb-2fbf-4661-b2d5-66d0156fcc34', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa7e55b-6e0b-41bb-acc8-45375fd61f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:26 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Volume volume-461b2bcb-2fbf-4661-b2d5-66d0156fcc34 (461b2bcb-2fbf-4661-b2d5-66d0156fcc34): created successfully Sep 28 16:14:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa7e55b-6e0b-41bb-acc8-45375fd61f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Flow 'volume_create_manager' (10482da9-47d3-4527-bad1-eaa41bb79dc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a1f320a0-0a49-46c4-8e13-3c7e7502d20b tempest-VolumesActionsTest-592197276 None] Created volume successfully. Sep 28 16:14:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] Acquiring lock "cinder-461b2bcb-2fbf-4661-b2d5-66d0156fcc34-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] Lock "cinder-461b2bcb-2fbf-4661-b2d5-66d0156fcc34-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] Acquiring lock "cinder-quobyte-461b2bcb-2fbf-4661-b2d5-66d0156fcc34" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] Lock "cinder-quobyte-461b2bcb-2fbf-4661-b2d5-66d0156fcc34" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:27 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f79ddc0-4f42-4ea1-9639-430343fea349]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-461b2bcb-2fbf-4661-b2d5-66d0156fcc34 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:28 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-461b2bcb-2fbf-4661-b2d5-66d0156fcc34 Sep 28 16:14:28 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:28 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-461b2bcb-2fbf-4661-b2d5-66d0156fcc34" returned: 0 in 0.495s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-461b2bcb-2fbf-4661-b2d5-66d0156fcc34 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:28 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-461b2bcb-2fbf-4661-b2d5-66d0156fcc34 Sep 28 16:14:28 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:28 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-461b2bcb-2fbf-4661-b2d5-66d0156fcc34" returned: 0 in 0.358s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] Lock "cinder-quobyte-461b2bcb-2fbf-4661-b2d5-66d0156fcc34" released by "delete_volume" :: held 0.921s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:28 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] Created reservations ['3adac833-011a-4e0f-9570-98c9235d8c73', 'bdc32058-326c-4a69-bd98-6b6385f56c2b', '7730f82f-fc9c-4ad7-bec7-7ff48df945bd', '06f46852-7fec-4ab7-a496-b499f687fbd2'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:29 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:14:29 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:29 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.390s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:29 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] Deleted volume successfully. Sep 28 16:14:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-922f3736-5811-4c1f-9ca2-7214deede67e tempest-VolumesActionsTest-1072265092 None] Lock "cinder-461b2bcb-2fbf-4661-b2d5-66d0156fcc34-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Flow 'volume_create_manager' (5244c69c-5e85-498f-88b8-0b69363fcf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebbb4054-c61e-478f-8d3d-395b193be689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebbb4054-c61e-478f-8d3d-395b193be689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1312227844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb16140a-de2f-4f4f-8cde-8bbff4e8792b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88cd7e87f30646ef95853bf630a652f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:30Z,use_quota=True,user_id='5236815be4ff4e74b783d74808604020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4add71-8925-454e-a41c-c5e180f109ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4add71-8925-454e-a41c-c5e180f109ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e032f506-05f3-476d-b479-4562171b3d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e032f506-05f3-476d-b479-4562171b3d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb16140a-de2f-4f4f-8cde-8bbff4e8792b', 'volume_name': 'volume-fb16140a-de2f-4f4f-8cde-8bbff4e8792b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b176c7b-84d9-4465-9048-73f0548cada8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b176c7b-84d9-4465-9048-73f0548cada8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5d31be-34c6-4bc1-af6c-4a506005f571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:30 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Volume fb16140a-de2f-4f4f-8cde-8bbff4e8792b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb16140a-de2f-4f4f-8cde-8bbff4e8792b', 'volume_size': 1} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1312227844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb16140a-de2f-4f4f-8cde-8bbff4e8792b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88cd7e87f30646ef95853bf630a652f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:30Z,use_quota=True,user_id='5236815be4ff4e74b783d74808604020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Creating volume fb16140a-de2f-4f4f-8cde-8bbff4e8792b {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:14:30 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-fb16140a-de2f-4f4f-8cde-8bbff4e8792b 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:30 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-fb16140a-de2f-4f4f-8cde-8bbff4e8792b 1073741824 Sep 28 16:14:30 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-1116fb0f-b817-4c75-a981-622992b17247 req-910abc29-f2d2-4c44-895a-71f320139b0f tempest-TestStampPattern-1714218360 None] Terminate volume connection completed successfully. Sep 28 16:14:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-1116fb0f-b817-4c75-a981-622992b17247 req-910abc29-f2d2-4c44-895a-71f320139b0f tempest-TestStampPattern-1714218360 None] Deleting attachment a61ef92d-75b2-46d8-a998-c896fae37edc. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:14:31 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-fb16140a-de2f-4f4f-8cde-8bbff4e8792b 1073741824" returned: 0 in 0.886s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-fb16140a-de2f-4f4f-8cde-8bbff4e8792b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:31 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-fb16140a-de2f-4f4f-8cde-8bbff4e8792b Sep 28 16:14:31 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-42ba8eb2-7efc-45ed-a450-0f99eacdfd63 tempest-TestStampPattern-1714218360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:31 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-fb16140a-de2f-4f4f-8cde-8bbff4e8792b" returned: 0 in 0.359s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:14:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-42ba8eb2-7efc-45ed-a450-0f99eacdfd63 tempest-TestStampPattern-1714218360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.059s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-42ba8eb2-7efc-45ed-a450-0f99eacdfd63 tempest-TestStampPattern-1714218360 None] Creating offline snapshot d35ffed6-381d-4ec5-9391-7f9161e9e3cb of volume 17363321-52fd-475d-8864-83e73af80655 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:14:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5d31be-34c6-4bc1-af6c-4a506005f571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb16140a-de2f-4f4f-8cde-8bbff4e8792b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ada152-fc77-4511-a271-0cf7c5f5e270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb519b2-d9b4-43d8-aa5d-9b76050560f6]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42ba8eb2-7efc-45ed-a450-0f99eacdfd63 tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:31 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Volume volume-fb16140a-de2f-4f4f-8cde-8bbff4e8792b (fb16140a-de2f-4f4f-8cde-8bbff4e8792b): created successfully Sep 28 16:14:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ada152-fc77-4511-a271-0cf7c5f5e270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Flow 'volume_create_manager' (5244c69c-5e85-498f-88b8-0b69363fcf8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:31 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c9c1eaf6-1fef-49a6-8766-29d4ff9b02de tempest-VolumesActionsTest-592197276 None] Created volume successfully. Sep 28 16:14:31 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655 Sep 28 16:14:31 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:32 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42ba8eb2-7efc-45ed-a450-0f99eacdfd63 tempest-TestStampPattern-1714218360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655" returned: 0 in 0.497s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42ba8eb2-7efc-45ed-a450-0f99eacdfd63 tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:32 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb 1G Sep 28 16:14:32 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] Acquiring lock "cinder-fb16140a-de2f-4f4f-8cde-8bbff4e8792b-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] Lock "cinder-fb16140a-de2f-4f4f-8cde-8bbff4e8792b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] Acquiring lock "cinder-quobyte-fb16140a-de2f-4f4f-8cde-8bbff4e8792b" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] Lock "cinder-quobyte-fb16140a-de2f-4f4f-8cde-8bbff4e8792b" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:32 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54c92c2-b5c2-4be4-b1d5-6ed9dde1cc69]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-fb16140a-de2f-4f4f-8cde-8bbff4e8792b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:32 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-fb16140a-de2f-4f4f-8cde-8bbff4e8792b Sep 28 16:14:32 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:32 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42ba8eb2-7efc-45ed-a450-0f99eacdfd63 tempest-TestStampPattern-1714218360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb 1G" returned: 0 in 0.579s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42ba8eb2-7efc-45ed-a450-0f99eacdfd63 tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17363321-52fd-475d-8864-83e73af80655 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:32 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17363321-52fd-475d-8864-83e73af80655 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb Sep 28 16:14:32 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:32 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-fb16140a-de2f-4f4f-8cde-8bbff4e8792b" returned: 0 in 0.468s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-fb16140a-de2f-4f4f-8cde-8bbff4e8792b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:32 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42ba8eb2-7efc-45ed-a450-0f99eacdfd63 tempest-TestStampPattern-1714218360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17363321-52fd-475d-8864-83e73af80655 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb" returned: 0 in 0.333s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:32 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-42ba8eb2-7efc-45ed-a450-0f99eacdfd63 tempest-TestStampPattern-1714218360 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb is being set with open permissions: ugo+rw Sep 28 16:14:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42ba8eb2-7efc-45ed-a450-0f99eacdfd63 tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:33 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-fb16140a-de2f-4f4f-8cde-8bbff4e8792b Sep 28 16:14:33 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:33 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb Sep 28 16:14:33 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:33 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42ba8eb2-7efc-45ed-a450-0f99eacdfd63 tempest-TestStampPattern-1714218360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb" returned: 0 in 0.285s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:33 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-fb16140a-de2f-4f4f-8cde-8bbff4e8792b" returned: 0 in 0.325s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] Lock "cinder-quobyte-fb16140a-de2f-4f4f-8cde-8bbff4e8792b" released by "delete_volume" :: held 0.869s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42ba8eb2-7efc-45ed-a450-0f99eacdfd63 tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:33 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.info Sep 28 16:14:33 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:33 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] Created reservations ['84d2a76a-a931-4f9b-9928-970993bd727f', 'e7bf504a-e4aa-414d-921e-c2592bc8cb05', '22eac19e-5117-4346-943e-cb1e14def739', 'a2582abd-f0ed-44a4-96a8-92043c4c136c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:33 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:14:33 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:33 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42ba8eb2-7efc-45ed-a450-0f99eacdfd63 tempest-TestStampPattern-1714218360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.info" returned: 0 in 0.351s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:33 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-42ba8eb2-7efc-45ed-a450-0f99eacdfd63 tempest-TestStampPattern-1714218360 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.info is being set with open permissions: ugo+rw Sep 28 16:14:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42ba8eb2-7efc-45ed-a450-0f99eacdfd63 tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:33 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.info Sep 28 16:14:33 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:34 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.493s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:34 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] Deleted volume successfully. Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-571bc881-18db-4004-84cc-12d0da63e63c tempest-VolumesActionsTest-1072265092 None] Lock "cinder-fb16140a-de2f-4f4f-8cde-8bbff4e8792b-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:34 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42ba8eb2-7efc-45ed-a450-0f99eacdfd63 tempest-TestStampPattern-1714218360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.info" returned: 0 in 0.468s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-42ba8eb2-7efc-45ed-a450-0f99eacdfd63 tempest-TestStampPattern-1714218360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.656s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:34 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-42ba8eb2-7efc-45ed-a450-0f99eacdfd63 tempest-TestStampPattern-1714218360 None] Create snapshot completed successfully Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Flow 'volume_create_manager' (9c080ce6-61d9-4c42-8830-46bd062a6209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4066a72b-3049-4faa-94a7-8d8679740e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4066a72b-3049-4faa-94a7-8d8679740e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2114837004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01debaf-65ff-44d1-8ca7-1299110fc44d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88cd7e87f30646ef95853bf630a652f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:34Z,use_quota=True,user_id='5236815be4ff4e74b783d74808604020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be13be9-6d85-46ed-b22d-9daab6f66b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be13be9-6d85-46ed-b22d-9daab6f66b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383d5821-60ec-4bca-8039-4bd84f89434e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383d5821-60ec-4bca-8039-4bd84f89434e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f01debaf-65ff-44d1-8ca7-1299110fc44d', 'volume_name': 'volume-f01debaf-65ff-44d1-8ca7-1299110fc44d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fede0db2-b1be-461c-b201-5792d1870aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fede0db2-b1be-461c-b201-5792d1870aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10eeabe9-d8f3-49ab-913e-15f4059b9a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:34 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Volume f01debaf-65ff-44d1-8ca7-1299110fc44d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f01debaf-65ff-44d1-8ca7-1299110fc44d', 'volume_size': 1} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2114837004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01debaf-65ff-44d1-8ca7-1299110fc44d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88cd7e87f30646ef95853bf630a652f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:34Z,use_quota=True,user_id='5236815be4ff4e74b783d74808604020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Creating volume f01debaf-65ff-44d1-8ca7-1299110fc44d {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:14:34 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:14:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f01debaf-65ff-44d1-8ca7-1299110fc44d 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:34 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f01debaf-65ff-44d1-8ca7-1299110fc44d 1073741824 Sep 28 16:14:34 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:35 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:14:35 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:35 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f01debaf-65ff-44d1-8ca7-1299110fc44d 1073741824" returned: 0 in 0.617s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f01debaf-65ff-44d1-8ca7-1299110fc44d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:35 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f01debaf-65ff-44d1-8ca7-1299110fc44d Sep 28 16:14:35 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:35 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.418s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:14:35 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f01debaf-65ff-44d1-8ca7-1299110fc44d" returned: 0 in 0.459s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10eeabe9-d8f3-49ab-913e-15f4059b9a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f01debaf-65ff-44d1-8ca7-1299110fc44d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4e844d-2587-4784-be3b-48f988382e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:35 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Volume volume-f01debaf-65ff-44d1-8ca7-1299110fc44d (f01debaf-65ff-44d1-8ca7-1299110fc44d): created successfully Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4e844d-2587-4784-be3b-48f988382e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Flow 'volume_create_manager' (9c080ce6-61d9-4c42-8830-46bd062a6209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:35 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0208b8b3-3b27-402f-958c-609aa75910ee tempest-VolumesActionsTest-592197276 None] Created volume successfully. Sep 28 16:14:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] Acquiring lock "cinder-f01debaf-65ff-44d1-8ca7-1299110fc44d-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] Lock "cinder-f01debaf-65ff-44d1-8ca7-1299110fc44d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] Acquiring lock "cinder-quobyte-f01debaf-65ff-44d1-8ca7-1299110fc44d" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] Lock "cinder-quobyte-f01debaf-65ff-44d1-8ca7-1299110fc44d" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cc1daf-488c-4c36-9791-27cc781c42bb]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f01debaf-65ff-44d1-8ca7-1299110fc44d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:37 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f01debaf-65ff-44d1-8ca7-1299110fc44d Sep 28 16:14:37 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:37 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f01debaf-65ff-44d1-8ca7-1299110fc44d" returned: 0 in 0.476s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f01debaf-65ff-44d1-8ca7-1299110fc44d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:37 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f01debaf-65ff-44d1-8ca7-1299110fc44d Sep 28 16:14:37 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:37 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f01debaf-65ff-44d1-8ca7-1299110fc44d" returned: 0 in 0.341s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] Lock "cinder-quobyte-f01debaf-65ff-44d1-8ca7-1299110fc44d" released by "delete_volume" :: held 0.901s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:38 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] Created reservations ['e44c7d28-f583-4202-8050-65ec477c36c8', 'eb90782e-00b5-4aba-a2ca-eb0123112f9c', '55f877b2-5d90-454b-882a-959d95b8bed3', 'b528e25c-a28b-40b7-b130-c3202b899ca7'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:38 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:14:38 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:38 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.273s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:38 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:38 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] Deleted volume successfully. Sep 28 16:14:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0e797c4f-3fc1-4213-bd5c-71820a16b4cb tempest-VolumesActionsTest-1072265092 None] Lock "cinder-f01debaf-65ff-44d1-8ca7-1299110fc44d-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:39 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:14:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Flow 'volume_create_manager' (0c8e5950-000a-450e-a0d3-a9a7c4e88d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37ec66f-cbd5-42fc-ba10-238b849fd90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37ec66f-cbd5-42fc-ba10-238b849fd90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-936663083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c3b012b-fc5b-493a-9437-2f39d291250c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88cd7e87f30646ef95853bf630a652f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:40Z,use_quota=True,user_id='5236815be4ff4e74b783d74808604020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43894f3e-5cd3-4c75-831a-a6a354876df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43894f3e-5cd3-4c75-831a-a6a354876df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e488483-c7f1-4dc5-add2-6f8fb14e0db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e488483-c7f1-4dc5-add2-6f8fb14e0db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c3b012b-fc5b-493a-9437-2f39d291250c', 'volume_name': 'volume-8c3b012b-fc5b-493a-9437-2f39d291250c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733fd9d2-483c-4a7c-ad28-f3ddfa39f85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733fd9d2-483c-4a7c-ad28-f3ddfa39f85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8723ce88-2da3-4d64-8654-7db2a449780e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:40 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Volume 8c3b012b-fc5b-493a-9437-2f39d291250c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c3b012b-fc5b-493a-9437-2f39d291250c', 'volume_size': 1} Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-936663083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c3b012b-fc5b-493a-9437-2f39d291250c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88cd7e87f30646ef95853bf630a652f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:40Z,use_quota=True,user_id='5236815be4ff4e74b783d74808604020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Creating volume 8c3b012b-fc5b-493a-9437-2f39d291250c {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:14:40 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c3b012b-fc5b-493a-9437-2f39d291250c 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:40 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c3b012b-fc5b-493a-9437-2f39d291250c 1073741824 Sep 28 16:14:40 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:40 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c3b012b-fc5b-493a-9437-2f39d291250c 1073741824" returned: 0 in 0.609s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c3b012b-fc5b-493a-9437-2f39d291250c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:40 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c3b012b-fc5b-493a-9437-2f39d291250c Sep 28 16:14:40 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:41 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c3b012b-fc5b-493a-9437-2f39d291250c" returned: 0 in 0.311s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:14:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8723ce88-2da3-4d64-8654-7db2a449780e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c3b012b-fc5b-493a-9437-2f39d291250c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35382e2e-7934-4296-b1d9-b9ad39ad1bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:41 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Volume volume-8c3b012b-fc5b-493a-9437-2f39d291250c (8c3b012b-fc5b-493a-9437-2f39d291250c): created successfully Sep 28 16:14:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35382e2e-7934-4296-b1d9-b9ad39ad1bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Flow 'volume_create_manager' (0c8e5950-000a-450e-a0d3-a9a7c4e88d02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:41 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-20d990bf-9a46-4ddf-8a2a-65d451d8545b tempest-VolumesActionsTest-592197276 None] Created volume successfully. Sep 28 16:14:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] Acquiring lock "cinder-8c3b012b-fc5b-493a-9437-2f39d291250c-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] Lock "cinder-8c3b012b-fc5b-493a-9437-2f39d291250c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] Acquiring lock "cinder-quobyte-8c3b012b-fc5b-493a-9437-2f39d291250c" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] Lock "cinder-quobyte-8c3b012b-fc5b-493a-9437-2f39d291250c" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:42 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb959b55-5837-4910-96ee-632882f12944]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c3b012b-fc5b-493a-9437-2f39d291250c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:42 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c3b012b-fc5b-493a-9437-2f39d291250c Sep 28 16:14:42 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:43 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c3b012b-fc5b-493a-9437-2f39d291250c" returned: 0 in 0.491s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c3b012b-fc5b-493a-9437-2f39d291250c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:43 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c3b012b-fc5b-493a-9437-2f39d291250c Sep 28 16:14:43 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:43 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c3b012b-fc5b-493a-9437-2f39d291250c" returned: 0 in 0.420s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] Lock "cinder-quobyte-8c3b012b-fc5b-493a-9437-2f39d291250c" released by "delete_volume" :: held 0.990s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:43 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] Created reservations ['8ed91515-8a0b-426b-8a9f-316b14aff179', '163a9feb-023c-41cc-a94f-96be97a91c04', 'a4c094e9-4ff1-43f3-ab9b-37027ce68f5c', '931a61a8-e56f-47e7-8401-993020758c7c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:43 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:14:43 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:44 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.336s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:44 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] Deleted volume successfully. Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6e6c324d-46fd-4d81-bc81-d64da3ca387f tempest-VolumesActionsTest-1072265092 None] Lock "cinder-8c3b012b-fc5b-493a-9437-2f39d291250c-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Flow 'volume_create_manager' (90e4124b-4979-4fa8-94b0-de5bfce88ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea739477-85ba-48d3-8a5e-606ddeb301ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea739477-85ba-48d3-8a5e-606ddeb301ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1452989950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e627e46-35b2-4b07-bf17-b12709b27fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70bb34282b21490fa6ce0803fe17515e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d35ffed6-381d-4ec5-9391-7f9161e9e3cb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:44Z,use_quota=True,user_id='1e69cb41353b4ac08c96b05d931b4d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39433626-c96f-489f-969b-1c8c2231e908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39433626-c96f-489f-969b-1c8c2231e908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ca172e-f44e-4733-a434-383efc1c7ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ca172e-f44e-4733-a434-383efc1c7ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7e627e46-35b2-4b07-bf17-b12709b27fb8', 'volume_name': 'volume-7e627e46-35b2-4b07-bf17-b12709b27fb8', 'volume_size': 1, 'snapshot_id': 'd35ffed6-381d-4ec5-9391-7f9161e9e3cb'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3136b60-b316-481f-9364-80ec41d4dcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3136b60-b316-481f-9364-80ec41d4dcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e3966b-a07e-42c7-8eee-8510b60dc162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:44 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Volume 7e627e46-35b2-4b07-bf17-b12709b27fb8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7e627e46-35b2-4b07-bf17-b12709b27fb8', 'volume_size': 1, 'snapshot_id': 'd35ffed6-381d-4ec5-9391-7f9161e9e3cb'} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Acquiring lock "cinder-quobyte-d35ffed6-381d-4ec5-9391-7f9161e9e3cb-7e627e46-35b2-4b07-bf17-b12709b27fb8" by "_create_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Lock "cinder-quobyte-d35ffed6-381d-4ec5-9391-7f9161e9e3cb-7e627e46-35b2-4b07-bf17-b12709b27fb8" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Creating volume 7e627e46-35b2-4b07-bf17-b12709b27fb8 from snapshot d35ffed6-381d-4ec5-9391-7f9161e9e3cb {{(pid=87087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Acquiring lock "cinder-quobyte-7e627e46-35b2-4b07-bf17-b12709b27fb8" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Lock "cinder-quobyte-7e627e46-35b2-4b07-bf17-b12709b27fb8" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] snapshot: d35ffed6-381d-4ec5-9391-7f9161e9e3cb, volume: 7e627e46-35b2-4b07-bf17-b12709b27fb8, {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[877a7a38-1658-4c78-9961-21c4cb3b1443]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:45 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb Sep 28 16:14:45 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:45 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb" returned: 0 in 0.627s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17363321-52fd-475d-8864-83e73af80655(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:14:45 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8d54df-e019-49f2-9d30-3d2b95a9a96d]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:45 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:14:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Flow 'volume_create_manager' (c6fa117b-e988-4415-b001-e2b17238d63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8eb641-6c58-41a1-8e5c-1e9b5756e16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8eb641-6c58-41a1-8e5c-1e9b5756e16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-667498147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6933650e-7663-4e16-ae2a-051aaadfaa0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88cd7e87f30646ef95853bf630a652f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:46Z,use_quota=True,user_id='5236815be4ff4e74b783d74808604020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:45 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655 Sep 28 16:14:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0aed31-6703-4881-bb0b-3ddd953bcfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:45 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0aed31-6703-4881-bb0b-3ddd953bcfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b2b4d7-bbc6-4640-ab73-ef05e240a161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b2b4d7-bbc6-4640-ab73-ef05e240a161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6933650e-7663-4e16-ae2a-051aaadfaa0a', 'volume_name': 'volume-6933650e-7663-4e16-ae2a-051aaadfaa0a', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274e1827-6098-4b06-a80c-5cbfab01cbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274e1827-6098-4b06-a80c-5cbfab01cbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43d65e7-d842-49b8-a316-9898e0192b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:45 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Volume 6933650e-7663-4e16-ae2a-051aaadfaa0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6933650e-7663-4e16-ae2a-051aaadfaa0a', 'volume_size': 1} Sep 28 16:14:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:46 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655" returned: 0 in 0.676s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655 {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:14:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:14:46 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Path /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e627e46-35b2-4b07-bf17-b12709b27fb8 not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:14:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e627e46-35b2-4b07-bf17-b12709b27fb8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:46 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e627e46-35b2-4b07-bf17-b12709b27fb8 Sep 28 16:14:46 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:55 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=74,cinder:SELECT=60,cinder:INSERT=15,cinder:DELETE=7 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:14:55 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=44,cinder:DELETE=4,cinder:SELECT=34,cinder:INSERT=11 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:14:56 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e627e46-35b2-4b07-bf17-b12709b27fb8" returned: 0 in 10.320s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:56 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655, size 1024.00 MB, duration 10.32 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e627e46-35b2-4b07-bf17-b12709b27fb8 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:14:56 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Converted 1024.00 MB image at 99.21 MB/s Sep 28 16:14:56 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e627e46-35b2-4b07-bf17-b12709b27fb8 is being set with open permissions: ugo+rw Sep 28 16:14:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e627e46-35b2-4b07-bf17-b12709b27fb8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:56 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e627e46-35b2-4b07-bf17-b12709b27fb8 Sep 28 16:14:56 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:56 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e627e46-35b2-4b07-bf17-b12709b27fb8" returned: 0 in 0.424s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Lock "cinder-quobyte-7e627e46-35b2-4b07-bf17-b12709b27fb8" released by "_copy_volume_from_snapshot" :: held 12.210s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Lock "cinder-quobyte-d35ffed6-381d-4ec5-9391-7f9161e9e3cb-7e627e46-35b2-4b07-bf17-b12709b27fb8" released by "_create_volume_from_snapshot" :: held 12.325s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.348s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.265s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-667498147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6933650e-7663-4e16-ae2a-051aaadfaa0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88cd7e87f30646ef95853bf630a652f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:46Z,use_quota=True,user_id='5236815be4ff4e74b783d74808604020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:14:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Creating volume 6933650e-7663-4e16-ae2a-051aaadfaa0a {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:14:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:14:57 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:14:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6933650e-7663-4e16-ae2a-051aaadfaa0a 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:57 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6933650e-7663-4e16-ae2a-051aaadfaa0a 1073741824 Sep 28 16:14:57 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e3966b-a07e-42c7-8eee-8510b60dc162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e627e46-35b2-4b07-bf17-b12709b27fb8', 'volume_size': 1, 'snapshot_id': 'd35ffed6-381d-4ec5-9391-7f9161e9e3cb'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb58455f-5bd9-49bf-b1a6-5639e104c623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:57 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Volume volume-7e627e46-35b2-4b07-bf17-b12709b27fb8 (7e627e46-35b2-4b07-bf17-b12709b27fb8): created successfully Sep 28 16:14:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb58455f-5bd9-49bf-b1a6-5639e104c623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Flow 'volume_create_manager' (90e4124b-4979-4fa8-94b0-de5bfce88ee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6a22b003-eb2d-4d42-a39e-9d3a445f133f tempest-TestStampPattern-1714218360 None] Created volume successfully. Sep 28 16:14:58 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6933650e-7663-4e16-ae2a-051aaadfaa0a 1073741824" returned: 0 in 0.936s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6933650e-7663-4e16-ae2a-051aaadfaa0a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:58 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6933650e-7663-4e16-ae2a-051aaadfaa0a Sep 28 16:14:58 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:58 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6933650e-7663-4e16-ae2a-051aaadfaa0a" returned: 0 in 0.385s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:14:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43d65e7-d842-49b8-a316-9898e0192b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6933650e-7663-4e16-ae2a-051aaadfaa0a', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b8febf4-0d58-4b8f-bdac-911ae10b12a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:58 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Volume volume-6933650e-7663-4e16-ae2a-051aaadfaa0a (6933650e-7663-4e16-ae2a-051aaadfaa0a): created successfully Sep 28 16:14:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b8febf4-0d58-4b8f-bdac-911ae10b12a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Flow 'volume_create_manager' (c6fa117b-e988-4415-b001-e2b17238d63c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-aa52e034-3ada-4082-8dcf-f3bc6bc57400 tempest-VolumesActionsTest-592197276 None] Created volume successfully. Sep 28 16:15:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] Acquiring lock "cinder-6933650e-7663-4e16-ae2a-051aaadfaa0a-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] Lock "cinder-6933650e-7663-4e16-ae2a-051aaadfaa0a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] Acquiring lock "cinder-quobyte-6933650e-7663-4e16-ae2a-051aaadfaa0a" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] Lock "cinder-quobyte-6933650e-7663-4e16-ae2a-051aaadfaa0a" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:00 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[04809c29-8a37-41d8-b872-ed0f6f21be65]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6933650e-7663-4e16-ae2a-051aaadfaa0a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:00 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6933650e-7663-4e16-ae2a-051aaadfaa0a Sep 28 16:15:00 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:00 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6933650e-7663-4e16-ae2a-051aaadfaa0a" returned: 0 in 0.494s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6933650e-7663-4e16-ae2a-051aaadfaa0a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:01 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6933650e-7663-4e16-ae2a-051aaadfaa0a Sep 28 16:15:01 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:01 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6933650e-7663-4e16-ae2a-051aaadfaa0a" returned: 0 in 0.536s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] Lock "cinder-quobyte-6933650e-7663-4e16-ae2a-051aaadfaa0a" released by "delete_volume" :: held 1.118s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:01 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] Created reservations ['ec19e7b8-04a7-4d6f-9c90-50ea607e1c0d', 'd29184ec-c52c-4f91-bcce-72d56507a817', 'aa0cbc82-875f-4fb7-9bd8-e77ec2188709', '109a9649-eb35-4766-a6cd-6fdd46b51bea'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:01 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:15:01 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:02 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.497s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:02 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:15:02 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] Deleted volume successfully. Sep 28 16:15:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34dd492b-7f7d-449a-9b50-e0d8993b6c27 tempest-VolumesActionsTest-592197276 None] Lock "cinder-6933650e-7663-4e16-ae2a-051aaadfaa0a-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:11 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=15,cinder:SELECT=5,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:15:12 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Flow 'volume_create_manager' (66e58a55-9879-47d4-be32-064fdf6a03c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19a30fb-a544-4523-9d96-dacabacdda2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19a30fb-a544-4523-9d96-dacabacdda2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-413203108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85cef08d-f00c-4370-aa76-2fa63526871f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1a085ef7da48c0bfa5d1ac96409f7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:23Z,use_quota=True,user_id='d8ab2957fe614a159460434c77a370e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1d59ca-5561-4b12-b2d1-1fecc591f404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1d59ca-5561-4b12-b2d1-1fecc591f404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94aa18b7-0178-43a3-a5b0-d2b275e993b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94aa18b7-0178-43a3-a5b0-d2b275e993b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85cef08d-f00c-4370-aa76-2fa63526871f', 'volume_name': 'volume-85cef08d-f00c-4370-aa76-2fa63526871f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9f26c5-a2e8-43af-8eb6-e171502608d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9f26c5-a2e8-43af-8eb6-e171502608d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084b7e51-bd86-4e77-8fd3-309cac5edd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:22 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Volume 85cef08d-f00c-4370-aa76-2fa63526871f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85cef08d-f00c-4370-aa76-2fa63526871f', 'volume_size': 1} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-413203108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85cef08d-f00c-4370-aa76-2fa63526871f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1a085ef7da48c0bfa5d1ac96409f7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:23Z,use_quota=True,user_id='d8ab2957fe614a159460434c77a370e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Creating volume 85cef08d-f00c-4370-aa76-2fa63526871f {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:15:22 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:15:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-85cef08d-f00c-4370-aa76-2fa63526871f 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:23 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-85cef08d-f00c-4370-aa76-2fa63526871f 1073741824 Sep 28 16:15:23 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:23 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-85cef08d-f00c-4370-aa76-2fa63526871f 1073741824" returned: 0 in 0.637s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-85cef08d-f00c-4370-aa76-2fa63526871f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:23 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-85cef08d-f00c-4370-aa76-2fa63526871f Sep 28 16:15:23 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:23 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-85cef08d-f00c-4370-aa76-2fa63526871f" returned: 0 in 0.338s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:15:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084b7e51-bd86-4e77-8fd3-309cac5edd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85cef08d-f00c-4370-aa76-2fa63526871f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af1c552-cde1-4d1b-9db2-6d336cb44411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:24 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Volume volume-85cef08d-f00c-4370-aa76-2fa63526871f (85cef08d-f00c-4370-aa76-2fa63526871f): created successfully Sep 28 16:15:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af1c552-cde1-4d1b-9db2-6d336cb44411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Flow 'volume_create_manager' (66e58a55-9879-47d4-be32-064fdf6a03c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-66bb9424-c07a-419b-a32c-e7234e954976 tempest-TestMinimumBasicScenario-97209991 None] Created volume successfully. Sep 28 16:15:24 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:15:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Flow 'volume_create_manager' (85c14d07-5305-4000-b63c-c748cf57edc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7155c0-03ae-457c-ab06-1e37b4855e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7155c0-03ae-457c-ab06-1e37b4855e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-52130917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0fe051-8284-46d9-a16f-2e8e1f80f032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c36b529a32748caafb2e2af68761858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:25Z,use_quota=True,user_id='333bf4fda8e849bdb46e8cb76b9417e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719cb87b-8de3-4c19-bf3b-b7a0dc18034a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719cb87b-8de3-4c19-bf3b-b7a0dc18034a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e17be44-9844-4218-a4d3-181b6f8895a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e17be44-9844-4218-a4d3-181b6f8895a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b0fe051-8284-46d9-a16f-2e8e1f80f032', 'volume_name': 'volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144794d2-a806-49d0-bce2-08b6a0f7e111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144794d2-a806-49d0-bce2-08b6a0f7e111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f845b0-9457-4da0-a804-43151742125b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:25 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Volume 3b0fe051-8284-46d9-a16f-2e8e1f80f032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032', 'volume_size': 1} Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-52130917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0fe051-8284-46d9-a16f-2e8e1f80f032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c36b529a32748caafb2e2af68761858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:25Z,use_quota=True,user_id='333bf4fda8e849bdb46e8cb76b9417e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Creating volume 3b0fe051-8284-46d9-a16f-2e8e1f80f032 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:15:25 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:25 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032 1073741824 Sep 28 16:15:25 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:25 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032 1073741824" returned: 0 in 0.533s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:25 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032 Sep 28 16:15:25 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:26 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032" returned: 0 in 0.488s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:15:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f845b0-9457-4da0-a804-43151742125b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cddf267e-f779-4d23-b282-5f85031622c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:26 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Volume volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032 (3b0fe051-8284-46d9-a16f-2e8e1f80f032): created successfully Sep 28 16:15:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cddf267e-f779-4d23-b282-5f85031622c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Flow 'volume_create_manager' (85c14d07-5305-4000-b63c-c748cf57edc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7da7205e-835b-4d0c-be07-3b4586408420 tempest-SnapshotMetadataTestJSON-1013041491 None] Created volume successfully. Sep 28 16:15:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-212c8453-9b5b-4e5a-8bde-030b8ca2c9c2 req-a488955c-65d8-46a9-b699-e519cdd59974 tempest-TestMinimumBasicScenario-97209991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-212c8453-9b5b-4e5a-8bde-030b8ca2c9c2 req-a488955c-65d8-46a9-b699-e519cdd59974 tempest-TestMinimumBasicScenario-97209991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-212c8453-9b5b-4e5a-8bde-030b8ca2c9c2 req-a488955c-65d8-46a9-b699-e519cdd59974 tempest-TestMinimumBasicScenario-97209991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-212c8453-9b5b-4e5a-8bde-030b8ca2c9c2 req-a488955c-65d8-46a9-b699-e519cdd59974 tempest-TestMinimumBasicScenario-97209991 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-85cef08d-f00c-4370-aa76-2fa63526871f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9330fab3-5e2a-4de0-9b73-a3be1a4e6a0a', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:15:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-212c8453-9b5b-4e5a-8bde-030b8ca2c9c2 req-a488955c-65d8-46a9-b699-e519cdd59974 tempest-TestMinimumBasicScenario-97209991 None] attachment_update completed successfully. Sep 28 16:15:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-36f3584f-b87f-410e-9c8f-75a8d53f87b7 tempest-SnapshotMetadataTestJSON-1013041491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-36f3584f-b87f-410e-9c8f-75a8d53f87b7 tempest-SnapshotMetadataTestJSON-1013041491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-36f3584f-b87f-410e-9c8f-75a8d53f87b7 tempest-SnapshotMetadataTestJSON-1013041491 None] Creating offline snapshot 4fb3c56b-b169-4333-958e-0462f2cb4992 of volume 3b0fe051-8284-46d9-a16f-2e8e1f80f032 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:15:27 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8697fbff-4fa7-44df-916a-bac637b1ea42]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36f3584f-b87f-410e-9c8f-75a8d53f87b7 tempest-SnapshotMetadataTestJSON-1013041491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:27 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032 Sep 28 16:15:27 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:28 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36f3584f-b87f-410e-9c8f-75a8d53f87b7 tempest-SnapshotMetadataTestJSON-1013041491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032" returned: 0 in 0.568s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36f3584f-b87f-410e-9c8f-75a8d53f87b7 tempest-SnapshotMetadataTestJSON-1013041491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:28 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992 1G Sep 28 16:15:28 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:28 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36f3584f-b87f-410e-9c8f-75a8d53f87b7 tempest-SnapshotMetadataTestJSON-1013041491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992 1G" returned: 0 in 0.584s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36f3584f-b87f-410e-9c8f-75a8d53f87b7 tempest-SnapshotMetadataTestJSON-1013041491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:28 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992 Sep 28 16:15:28 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:29 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36f3584f-b87f-410e-9c8f-75a8d53f87b7 tempest-SnapshotMetadataTestJSON-1013041491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992" returned: 0 in 0.410s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:29 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-36f3584f-b87f-410e-9c8f-75a8d53f87b7 tempest-SnapshotMetadataTestJSON-1013041491 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992 is being set with open permissions: ugo+rw Sep 28 16:15:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36f3584f-b87f-410e-9c8f-75a8d53f87b7 tempest-SnapshotMetadataTestJSON-1013041491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:29 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992 Sep 28 16:15:29 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:29 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36f3584f-b87f-410e-9c8f-75a8d53f87b7 tempest-SnapshotMetadataTestJSON-1013041491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992" returned: 0 in 0.322s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36f3584f-b87f-410e-9c8f-75a8d53f87b7 tempest-SnapshotMetadataTestJSON-1013041491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:29 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.info Sep 28 16:15:29 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:29 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36f3584f-b87f-410e-9c8f-75a8d53f87b7 tempest-SnapshotMetadataTestJSON-1013041491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.info" returned: 0 in 0.449s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:29 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-36f3584f-b87f-410e-9c8f-75a8d53f87b7 tempest-SnapshotMetadataTestJSON-1013041491 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.info is being set with open permissions: ugo+rw Sep 28 16:15:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36f3584f-b87f-410e-9c8f-75a8d53f87b7 tempest-SnapshotMetadataTestJSON-1013041491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:29 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.info Sep 28 16:15:29 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-868e6f08-e368-472c-815b-8124b3290f3e req-a91f593b-5275-4ecd-88bd-015817223348 tempest-TestStampPattern-1714218360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:30 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36f3584f-b87f-410e-9c8f-75a8d53f87b7 tempest-SnapshotMetadataTestJSON-1013041491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.info" returned: 0 in 0.319s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-36f3584f-b87f-410e-9c8f-75a8d53f87b7 tempest-SnapshotMetadataTestJSON-1013041491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.788s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-868e6f08-e368-472c-815b-8124b3290f3e req-a91f593b-5275-4ecd-88bd-015817223348 tempest-TestStampPattern-1714218360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.107s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-868e6f08-e368-472c-815b-8124b3290f3e req-a91f593b-5275-4ecd-88bd-015817223348 tempest-TestStampPattern-1714218360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-36f3584f-b87f-410e-9c8f-75a8d53f87b7 tempest-SnapshotMetadataTestJSON-1013041491 None] Create snapshot completed successfully Sep 28 16:15:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-868e6f08-e368-472c-815b-8124b3290f3e req-a91f593b-5275-4ecd-88bd-015817223348 tempest-TestStampPattern-1714218360 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-7e627e46-35b2-4b07-bf17-b12709b27fb8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f34d72f4-fd91-4a3d-8bd1-80c581fc798d', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:15:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-868e6f08-e368-472c-815b-8124b3290f3e req-a91f593b-5275-4ecd-88bd-015817223348 tempest-TestStampPattern-1714218360 None] attachment_update completed successfully. Sep 28 16:15:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] Acquiring lock "cinder-4fb3c56b-b169-4333-958e-0462f2cb4992-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] Lock "cinder-4fb3c56b-b169-4333-958e-0462f2cb4992-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] Acquiring lock "cinder-quobyte-3b0fe051-8284-46d9-a16f-2e8e1f80f032" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] Lock "cinder-quobyte-3b0fe051-8284-46d9-a16f-2e8e1f80f032" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] Acquiring lock "cinder-quobyte-4fb3c56b-b169-4333-958e-0462f2cb4992" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] Lock "cinder-quobyte-4fb3c56b-b169-4333-958e-0462f2cb4992" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] Deleting offline snapshot 4fb3c56b-b169-4333-958e-0462f2cb4992 of volume 3b0fe051-8284-46d9-a16f-2e8e1f80f032 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:15:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] snapshot_file for this snap is: volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:15:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfa5aa3-1646-4a85-89c6-9a8d859e485e]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:32 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992 Sep 28 16:15:32 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:32 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992" returned: 0 in 0.504s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:15:32 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c030360-2289-4255-ab63-7616c2a9ab2c]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:32 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032 Sep 28 16:15:32 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:33 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032" returned: 0 in 0.659s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:33 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992 Sep 28 16:15:33 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:34 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992" returned: 0 in 0.932s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:34 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992 Sep 28 16:15:34 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:34 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032.4fb3c56b-b169-4333-958e-0462f2cb4992" returned: 0 in 0.624s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] Lock "cinder-quobyte-4fb3c56b-b169-4333-958e-0462f2cb4992" released by "_delete_snapshot" :: held 2.923s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] Lock "cinder-quobyte-3b0fe051-8284-46d9-a16f-2e8e1f80f032" released by "delete_snapshot" :: held 2.979s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:34 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] Created reservations ['d2ec06d9-6def-4694-97b0-34dd48838158', '767d66d8-7f4c-4ba3-b888-0024ae0ec528', '97ccc8ac-26f5-4ca3-b649-c8ed53366f2e', 'b8be21bd-44dc-46e2-b4fc-3afcfe1d2650'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:35 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:15:35 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:35 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-07b0d12e-fc12-4c24-87e6-de55cd46c48a req-bb26eb52-5ebb-48c8-809a-2b0c35e753cb tempest-TestStampPattern-1714218360 None] Terminate volume connection completed successfully. Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-07b0d12e-fc12-4c24-87e6-de55cd46c48a req-bb26eb52-5ebb-48c8-809a-2b0c35e753cb tempest-TestStampPattern-1714218360 None] Deleting attachment f34d72f4-fd91-4a3d-8bd1-80c581fc798d. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:15:35 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] Delete snapshot completed successfully. Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eb2891f5-ec25-4ca7-8488-9fad26d273ef tempest-SnapshotMetadataTestJSON-1013041491 None] Lock "cinder-4fb3c56b-b169-4333-958e-0462f2cb4992-delete_snapshot" released by "delete_snapshot" :: held 3.336s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] Acquiring lock "cinder-3b0fe051-8284-46d9-a16f-2e8e1f80f032-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] Lock "cinder-3b0fe051-8284-46d9-a16f-2e8e1f80f032-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] Acquiring lock "cinder-quobyte-3b0fe051-8284-46d9-a16f-2e8e1f80f032" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:35 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.597s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] Lock "cinder-quobyte-3b0fe051-8284-46d9-a16f-2e8e1f80f032" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a08ddf-b5ff-4a77-8075-f7f8560d221f]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:35 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032 Sep 28 16:15:35 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:36 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032" returned: 0 in 0.537s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:36 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032 Sep 28 16:15:36 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:36 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b0fe051-8284-46d9-a16f-2e8e1f80f032" returned: 0 in 0.360s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] Lock "cinder-quobyte-3b0fe051-8284-46d9-a16f-2e8e1f80f032" released by "delete_volume" :: held 1.014s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:36 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] Created reservations ['2abaee75-ecb1-4453-bd32-76477d916a7b', 'ad5015ac-7b89-46ac-9436-b349909bc99f', '0558620d-c990-4c98-b679-e3d6c0018704', '4e6a87fc-3088-4df8-ae94-f995de7199e4'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:36 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:15:36 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:37 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.349s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:37 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:15:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] Deleted volume successfully. Sep 28 16:15:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-00ca79f1-45aa-4daa-beef-6eb496c85cba tempest-SnapshotMetadataTestJSON-1013041491 None] Lock "cinder-3b0fe051-8284-46d9-a16f-2e8e1f80f032-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] Acquiring lock "cinder-7e627e46-35b2-4b07-bf17-b12709b27fb8-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] Lock "cinder-7e627e46-35b2-4b07-bf17-b12709b27fb8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] Acquiring lock "cinder-quobyte-7e627e46-35b2-4b07-bf17-b12709b27fb8" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] Lock "cinder-quobyte-7e627e46-35b2-4b07-bf17-b12709b27fb8" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:42 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d674a4c7-4295-482b-a0a9-9bb207c61011]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e627e46-35b2-4b07-bf17-b12709b27fb8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:42 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e627e46-35b2-4b07-bf17-b12709b27fb8 Sep 28 16:15:42 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:42 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e627e46-35b2-4b07-bf17-b12709b27fb8" returned: 0 in 0.482s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e627e46-35b2-4b07-bf17-b12709b27fb8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:42 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e627e46-35b2-4b07-bf17-b12709b27fb8 Sep 28 16:15:42 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:42 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7e627e46-35b2-4b07-bf17-b12709b27fb8" returned: 0 in 0.291s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] Lock "cinder-quobyte-7e627e46-35b2-4b07-bf17-b12709b27fb8" released by "delete_volume" :: held 0.845s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:42 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] Created reservations ['398136cd-f136-436a-a967-eff1a9b6560e', '46d1929f-4015-4af8-902c-027d2e12e4bf', '4294c96d-8a8a-40bd-bb03-0ad7c94895bd', '0ffbc8f9-df2b-4886-bd36-eb4458b9d3c2'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:43 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:15:43 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:43 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.365s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:43 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:15:43 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] Deleted volume successfully. Sep 28 16:15:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-307080b5-c458-41fa-912c-a7b6667262c8 tempest-TestStampPattern-1714218360 None] Lock "cinder-7e627e46-35b2-4b07-bf17-b12709b27fb8-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] Acquiring lock "cinder-d35ffed6-381d-4ec5-9391-7f9161e9e3cb-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] Lock "cinder-d35ffed6-381d-4ec5-9391-7f9161e9e3cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] Acquiring lock "cinder-quobyte-17363321-52fd-475d-8864-83e73af80655" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] Lock "cinder-quobyte-17363321-52fd-475d-8864-83e73af80655" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] Acquiring lock "cinder-quobyte-d35ffed6-381d-4ec5-9391-7f9161e9e3cb" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] Lock "cinder-quobyte-d35ffed6-381d-4ec5-9391-7f9161e9e3cb" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] Deleting offline snapshot d35ffed6-381d-4ec5-9391-7f9161e9e3cb of volume 17363321-52fd-475d-8864-83e73af80655 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:15:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] snapshot_file for this snap is: volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:15:43 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d31b35e-cd62-463c-ab11-482f9d0875b2]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:43 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb Sep 28 16:15:43 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:44 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb" returned: 0 in 0.473s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17363321-52fd-475d-8864-83e73af80655(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:15:44 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b3acc2-fe70-47e9-85aa-b448cff3b52f]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:44 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655 Sep 28 16:15:44 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:44 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655" returned: 0 in 0.636s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:44 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb Sep 28 16:15:44 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:44 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:15:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Flow 'volume_create_manager' (1e3b2d9b-6d1c-4ca8-b365-c206fcc15479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d53c42-de69-472e-adb7-bba091ba1f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d53c42-de69-472e-adb7-bba091ba1f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1883598676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd40f5cc91a4dc38c5067afe7916631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:45Z,use_quota=True,user_id='35601a1e604442aaaf0a1455adc825e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82aaec56-14ab-4fc5-b0a9-cb4df7e8de31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82aaec56-14ab-4fc5-b0a9-cb4df7e8de31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d524a57-897e-401a-a33b-57a3fcbf4ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d524a57-897e-401a-a33b-57a3fcbf4ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5', 'volume_name': 'volume-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93077e65-bc8e-4d30-b5e1-392076435138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93077e65-bc8e-4d30-b5e1-392076435138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0bdae87-708b-43a8-9fb5-75a7615cb83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:45 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Volume 5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5', 'volume_size': 1} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1883598676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd40f5cc91a4dc38c5067afe7916631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:45Z,use_quota=True,user_id='35601a1e604442aaaf0a1455adc825e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Creating volume 5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:15:45 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:45 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5 1073741824 Sep 28 16:15:45 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:45 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb" returned: 0 in 0.489s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:45 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb Sep 28 16:15:45 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:45 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655.d35ffed6-381d-4ec5-9391-7f9161e9e3cb" returned: 0 in 0.326s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] Lock "cinder-quobyte-d35ffed6-381d-4ec5-9391-7f9161e9e3cb" released by "_delete_snapshot" :: held 2.089s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] Lock "cinder-quobyte-17363321-52fd-475d-8864-83e73af80655" released by "delete_snapshot" :: held 2.128s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:45 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5 1073741824" returned: 0 in 0.634s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] Created reservations ['5afa6901-edba-447c-92da-d724983561cf', 'd281ab36-7c09-40b6-a0a1-dfc37b228db7', '6d890ec0-0cb8-43be-89c4-69e532168b4d', '467e5b73-d480-41a4-a666-fbb0f7118a24'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:45 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5 Sep 28 16:15:45 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:45 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] Delete snapshot completed successfully. Sep 28 16:15:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-05ff9804-448b-49a3-8ce0-dad509d9ceee tempest-TestStampPattern-1714218360 None] Lock "cinder-d35ffed6-381d-4ec5-9391-7f9161e9e3cb-delete_snapshot" released by "delete_snapshot" :: held 2.392s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:46 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5" returned: 0 in 0.354s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:15:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0bdae87-708b-43a8-9fb5-75a7615cb83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf94e7a6-31c0-4049-9cb9-8befd6e1a982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:46 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Volume volume-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5 (5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5): created successfully Sep 28 16:15:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf94e7a6-31c0-4049-9cb9-8befd6e1a982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Flow 'volume_create_manager' (1e3b2d9b-6d1c-4ca8-b365-c206fcc15479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:46 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-51d2fb36-b7c7-42f9-ae75-aac07e61b0cb tempest-AbsoluteLimitsTests-175609681 None] Created volume successfully. Sep 28 16:15:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] Acquiring lock "cinder-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] Lock "cinder-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] Acquiring lock "cinder-quobyte-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] Lock "cinder-quobyte-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:47 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[990e8f02-213c-4d15-9abd-151bea071507]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:47 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5 Sep 28 16:15:47 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:48 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5" returned: 0 in 0.623s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:48 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5 Sep 28 16:15:48 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:48 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5" returned: 0 in 0.388s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] Lock "cinder-quobyte-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5" released by "delete_volume" :: held 1.090s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:48 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] Created reservations ['8f081e90-66bd-43c3-a5e2-c55a9ead4c58', '8765b5d9-faf0-4210-88c9-5e87c99cfdf3', '2bd1327e-1295-4099-a04a-b480f95a83fb', '33f56676-f9f9-44fc-91c3-1fafef91faf5'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:48 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:15:48 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:49 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.402s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:49 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:15:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] Deleted volume successfully. Sep 28 16:15:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8c21e3ac-e407-4d43-ae7f-b4363cfb31ea tempest-AbsoluteLimitsTests-175609681 None] Lock "cinder-5002b1b0-b9d4-43fe-bbfb-b58cdd66e4a5-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] Acquiring lock "cinder-17363321-52fd-475d-8864-83e73af80655-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] Lock "cinder-17363321-52fd-475d-8864-83e73af80655-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] Acquiring lock "cinder-quobyte-17363321-52fd-475d-8864-83e73af80655" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] Lock "cinder-quobyte-17363321-52fd-475d-8864-83e73af80655" acquired by "delete_volume" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:51 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[561da298-013c-46db-b263-78cec367c568]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:52 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655 Sep 28 16:15:52 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:52 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655" returned: 0 in 0.692s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:52 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655 Sep 28 16:15:52 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:53 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-17363321-52fd-475d-8864-83e73af80655" returned: 0 in 0.511s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] Lock "cinder-quobyte-17363321-52fd-475d-8864-83e73af80655" released by "delete_volume" :: held 1.343s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:53 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] Created reservations ['3b338347-249a-490b-b50a-7e9303c8cefc', 'e86290b4-1e5e-4e2e-99b5-e4dd93bf0feb', '4b96e20f-1446-4cf5-a62b-d001c3f00509', 'e816cd4f-fa1c-49be-a974-4dbe0724ff58'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:53 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:15:53 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:53 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.493s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:15:54 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] Deleted volume successfully. Sep 28 16:15:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8ea3188-1996-409d-a1fe-96824991bdbe tempest-TestStampPattern-1714218360 None] Lock "cinder-17363321-52fd-475d-8864-83e73af80655-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Flow 'volume_create_manager' (259b3495-54b5-444d-8b10-c36f3f73122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e32ec3-7bda-4174-82bd-863760934f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e32ec3-7bda-4174-82bd-863760934f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1439129815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999c1fd4-d443-4375-a16f-c0a878e4154e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9195e2725d942038035daacc8acdae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:58Z,use_quota=True,user_id='b0ad190c04aa478a9aabcc3c54e59995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f469e8-fe3c-4c3b-afe4-c93f32411380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f469e8-fe3c-4c3b-afe4-c93f32411380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8964d7e9-9810-4ee6-856b-dda35535d9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8964d7e9-9810-4ee6-856b-dda35535d9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '999c1fd4-d443-4375-a16f-c0a878e4154e', 'volume_name': 'volume-999c1fd4-d443-4375-a16f-c0a878e4154e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4819ef7d-ca97-40a1-ae88-2deb7c582628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4819ef7d-ca97-40a1-ae88-2deb7c582628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5051d18b-6b87-4e7d-9602-865fc639117a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:57 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Volume 999c1fd4-d443-4375-a16f-c0a878e4154e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-999c1fd4-d443-4375-a16f-c0a878e4154e', 'volume_size': 1} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1439129815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999c1fd4-d443-4375-a16f-c0a878e4154e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9195e2725d942038035daacc8acdae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:58Z,use_quota=True,user_id='b0ad190c04aa478a9aabcc3c54e59995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Creating volume 999c1fd4-d443-4375-a16f-c0a878e4154e {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:15:57 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:15:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:57 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e 1073741824 Sep 28 16:15:57 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:58 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e 1073741824" returned: 0 in 0.605s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:58 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e Sep 28 16:15:58 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:58 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e" returned: 0 in 0.317s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:15:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5051d18b-6b87-4e7d-9602-865fc639117a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-999c1fd4-d443-4375-a16f-c0a878e4154e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10904b8b-737b-48d5-94c7-35fe9bf748a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:58 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Volume volume-999c1fd4-d443-4375-a16f-c0a878e4154e (999c1fd4-d443-4375-a16f-c0a878e4154e): created successfully Sep 28 16:15:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10904b8b-737b-48d5-94c7-35fe9bf748a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Flow 'volume_create_manager' (259b3495-54b5-444d-8b10-c36f3f73122d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9d36c068-9362-4ef0-a124-8f9bdd8e6c3f tempest-VolumesDeleteCascade-1816262167 None] Created volume successfully. Sep 28 16:16:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1ffc97e5-431e-40bc-9531-04b58cecfae5 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1ffc97e5-431e-40bc-9531-04b58cecfae5 tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1ffc97e5-431e-40bc-9531-04b58cecfae5 tempest-VolumesDeleteCascade-1816262167 None] Creating offline snapshot 6987fa44-e157-4b45-b962-cdd3554dc611 of volume 999c1fd4-d443-4375-a16f-c0a878e4154e {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:16:00 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[df69978a-cb97-4a7a-ae57-fc566ac181d2]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1ffc97e5-431e-40bc-9531-04b58cecfae5 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:00 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e Sep 28 16:16:00 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:00 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1ffc97e5-431e-40bc-9531-04b58cecfae5 tempest-VolumesDeleteCascade-1816262167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e" returned: 0 in 0.573s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1ffc97e5-431e-40bc-9531-04b58cecfae5 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:00 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 1G Sep 28 16:16:00 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:01 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1ffc97e5-431e-40bc-9531-04b58cecfae5 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 1G" returned: 0 in 0.633s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1ffc97e5-431e-40bc-9531-04b58cecfae5 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-999c1fd4-d443-4375-a16f-c0a878e4154e -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:01 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-999c1fd4-d443-4375-a16f-c0a878e4154e -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 Sep 28 16:16:01 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:01 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1ffc97e5-431e-40bc-9531-04b58cecfae5 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-999c1fd4-d443-4375-a16f-c0a878e4154e -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611" returned: 0 in 0.433s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:01 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-1ffc97e5-431e-40bc-9531-04b58cecfae5 tempest-VolumesDeleteCascade-1816262167 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 is being set with open permissions: ugo+rw Sep 28 16:16:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1ffc97e5-431e-40bc-9531-04b58cecfae5 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:01 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 Sep 28 16:16:01 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:02 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1ffc97e5-431e-40bc-9531-04b58cecfae5 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611" returned: 0 in 0.307s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1ffc97e5-431e-40bc-9531-04b58cecfae5 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:02 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.info Sep 28 16:16:02 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:02 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1ffc97e5-431e-40bc-9531-04b58cecfae5 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.info" returned: 0 in 0.428s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:02 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-1ffc97e5-431e-40bc-9531-04b58cecfae5 tempest-VolumesDeleteCascade-1816262167 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.info is being set with open permissions: ugo+rw Sep 28 16:16:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1ffc97e5-431e-40bc-9531-04b58cecfae5 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:02 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.info Sep 28 16:16:02 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:02 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1ffc97e5-431e-40bc-9531-04b58cecfae5 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.info" returned: 0 in 0.325s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1ffc97e5-431e-40bc-9531-04b58cecfae5 tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.841s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1ffc97e5-431e-40bc-9531-04b58cecfae5 tempest-VolumesDeleteCascade-1816262167 None] Create snapshot completed successfully Sep 28 16:16:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3bf3a91d-569c-4e99-b38f-58833ba45f43 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3bf3a91d-569c-4e99-b38f-58833ba45f43 tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3bf3a91d-569c-4e99-b38f-58833ba45f43 tempest-VolumesDeleteCascade-1816262167 None] Creating offline snapshot 3f76240c-09ef-40b4-9713-cfe1784f2b48 of volume 999c1fd4-d443-4375-a16f-c0a878e4154e {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:16:03 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cdf954-2243-44e7-912b-eca718893be0]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3bf3a91d-569c-4e99-b38f-58833ba45f43 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:03 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 Sep 28 16:16:03 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:04 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3bf3a91d-569c-4e99-b38f-58833ba45f43 tempest-VolumesDeleteCascade-1816262167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611" returned: 0 in 0.544s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3bf3a91d-569c-4e99-b38f-58833ba45f43 tempest-VolumesDeleteCascade-1816262167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-999c1fd4-d443-4375-a16f-c0a878e4154e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:16:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3bf3a91d-569c-4e99-b38f-58833ba45f43 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:04 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48 1G Sep 28 16:16:04 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:04 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3bf3a91d-569c-4e99-b38f-58833ba45f43 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48 1G" returned: 0 in 0.638s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3bf3a91d-569c-4e99-b38f-58833ba45f43 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:05 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48 Sep 28 16:16:05 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:05 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3bf3a91d-569c-4e99-b38f-58833ba45f43 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48" returned: 0 in 0.481s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:05 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-3bf3a91d-569c-4e99-b38f-58833ba45f43 tempest-VolumesDeleteCascade-1816262167 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48 is being set with open permissions: ugo+rw Sep 28 16:16:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3bf3a91d-569c-4e99-b38f-58833ba45f43 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:05 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48 Sep 28 16:16:05 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:05 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3bf3a91d-569c-4e99-b38f-58833ba45f43 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48" returned: 0 in 0.365s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3bf3a91d-569c-4e99-b38f-58833ba45f43 tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.216s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:05 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3bf3a91d-569c-4e99-b38f-58833ba45f43 tempest-VolumesDeleteCascade-1816262167 None] Create snapshot completed successfully Sep 28 16:16:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "cinder-999c1fd4-d443-4375-a16f-c0a878e4154e-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-999c1fd4-d443-4375-a16f-c0a878e4154e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Performing cascade delete. {{(pid=87087) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 16:16:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "cinder-3f76240c-09ef-40b4-9713-cfe1784f2b48-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-3f76240c-09ef-40b4-9713-cfe1784f2b48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "cinder-quobyte-999c1fd4-d443-4375-a16f-c0a878e4154e" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-999c1fd4-d443-4375-a16f-c0a878e4154e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "cinder-quobyte-3f76240c-09ef-40b4-9713-cfe1784f2b48" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-3f76240c-09ef-40b4-9713-cfe1784f2b48" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Deleting offline snapshot 3f76240c-09ef-40b4-9713-cfe1784f2b48 of volume 999c1fd4-d443-4375-a16f-c0a878e4154e {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:16:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] snapshot_file for this snap is: volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:16:07 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe78015-d93b-4179-b11f-bd61565edbda]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:07 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48 Sep 28 16:16:07 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:07 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48" returned: 0 in 0.486s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-999c1fd4-d443-4375-a16f-c0a878e4154e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:16:07 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[519e8268-053a-43c7-9e8c-d73e0ed8b703]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:07 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 Sep 28 16:16:07 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:08 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611" returned: 0 in 0.454s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-999c1fd4-d443-4375-a16f-c0a878e4154e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:16:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:08 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48 Sep 28 16:16:08 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:08 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48" returned: 0 in 0.506s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:08 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48 Sep 28 16:16:08 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:09 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.3f76240c-09ef-40b4-9713-cfe1784f2b48" returned: 0 in 0.317s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-3f76240c-09ef-40b4-9713-cfe1784f2b48" released by "_delete_snapshot" :: held 1.923s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-999c1fd4-d443-4375-a16f-c0a878e4154e" released by "delete_snapshot" :: held 1.957s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:09 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Created reservations ['5a83cb2c-c6e7-443e-92b1-89c570dd469d', 'ae2c50ed-0d04-4312-a644-88e7feb523ff', 'd4b55f2c-1ecb-4133-9080-c81a68980fdc', '3329fbe4-aa62-492e-b1d5-281404cee676'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:16:09 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Delete snapshot completed successfully. Sep 28 16:16:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-3f76240c-09ef-40b4-9713-cfe1784f2b48-delete_snapshot" released by "delete_snapshot" :: held 2.175s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "cinder-6987fa44-e157-4b45-b962-cdd3554dc611-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-6987fa44-e157-4b45-b962-cdd3554dc611-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "cinder-quobyte-999c1fd4-d443-4375-a16f-c0a878e4154e" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-999c1fd4-d443-4375-a16f-c0a878e4154e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "cinder-quobyte-6987fa44-e157-4b45-b962-cdd3554dc611" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-6987fa44-e157-4b45-b962-cdd3554dc611" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Deleting offline snapshot 6987fa44-e157-4b45-b962-cdd3554dc611 of volume 999c1fd4-d443-4375-a16f-c0a878e4154e {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:16:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] snapshot_file for this snap is: volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:16:09 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[152fb8f7-60bd-4f64-a021-1271d896c4fe]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:09 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 Sep 28 16:16:09 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:09 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611" returned: 0 in 0.440s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-999c1fd4-d443-4375-a16f-c0a878e4154e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:16:09 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebc3802-4a63-46bb-8828-3086947bf14d]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:10 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e Sep 28 16:16:10 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:10 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e" returned: 0 in 0.451s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:10 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 Sep 28 16:16:10 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:10 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611" returned: 0 in 0.371s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:10 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611 Sep 28 16:16:10 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:11 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e.6987fa44-e157-4b45-b962-cdd3554dc611" returned: 0 in 0.282s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-6987fa44-e157-4b45-b962-cdd3554dc611" released by "_delete_snapshot" :: held 1.690s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-999c1fd4-d443-4375-a16f-c0a878e4154e" released by "delete_snapshot" :: held 1.713s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:11 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Created reservations ['865c644c-99da-41a8-bd1f-c7a14f7af522', '1b079195-12a9-422c-890d-1d5e1d6f4783', '98548016-d038-4aad-9c1b-8a14ed41004a', '1d9540f4-f764-4d5b-a537-ad0b87599964'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:16:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Delete snapshot completed successfully. Sep 28 16:16:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-6987fa44-e157-4b45-b962-cdd3554dc611-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Snapshots deleted, issuing volume delete {{(pid=87087) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 16:16:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "cinder-quobyte-999c1fd4-d443-4375-a16f-c0a878e4154e" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-999c1fd4-d443-4375-a16f-c0a878e4154e" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:11 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a450e1ea-a2c7-4335-9e7a-53efc2fcd090]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:11 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e Sep 28 16:16:11 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:11 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e" returned: 0 in 0.402s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:11 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e Sep 28 16:16:11 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:11 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-999c1fd4-d443-4375-a16f-c0a878e4154e" returned: 0 in 0.308s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-999c1fd4-d443-4375-a16f-c0a878e4154e" released by "delete_volume" :: held 0.785s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:12 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Created reservations ['b08f4746-e86a-4a6d-b9e7-c4219d14bef7', 'f4706f61-8e72-4185-9edd-302bb6c42b52', 'a337b09d-526a-47cf-8fd0-f982f33088ca', 'b53f944f-9ca8-49e5-a1cc-95a0c13ffa0f'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:16:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:12 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:16:12 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:12 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.258s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:12 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:16:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Deleted volume successfully. Sep 28 16:16:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6a838f35-0c67-4722-9365-7adbd5107da7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-999c1fd4-d443-4375-a16f-c0a878e4154e-delete_volume" released by "delete_volume" :: held 5.457s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Flow 'volume_create_manager' (2ddc71ea-4ba1-4fe8-ac59-b0ce500fbb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa37f64-1b26-44f7-ad0a-c427fb870b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa37f64-1b26-44f7-ad0a-c427fb870b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1071873635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace0b567-276f-44bd-809c-7b881f4032dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9195e2725d942038035daacc8acdae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:16:13Z,use_quota=True,user_id='b0ad190c04aa478a9aabcc3c54e59995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13864c0-e33b-43cc-a7db-db06fb2e2fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13864c0-e33b-43cc-a7db-db06fb2e2fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7a2d8e-5d4a-4f82-976c-02e6f25448ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7a2d8e-5d4a-4f82-976c-02e6f25448ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ace0b567-276f-44bd-809c-7b881f4032dc', 'volume_name': 'volume-ace0b567-276f-44bd-809c-7b881f4032dc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1adf9c12-118b-483c-829f-ba7b123affb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1adf9c12-118b-483c-829f-ba7b123affb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecdf04b9-9dc3-4b89-ad4d-748ce2c098e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:13 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Volume ace0b567-276f-44bd-809c-7b881f4032dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ace0b567-276f-44bd-809c-7b881f4032dc', 'volume_size': 1} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1071873635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace0b567-276f-44bd-809c-7b881f4032dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9195e2725d942038035daacc8acdae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:16:13Z,use_quota=True,user_id='b0ad190c04aa478a9aabcc3c54e59995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Creating volume ace0b567-276f-44bd-809c-7b881f4032dc {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:16:13 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:16:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:13 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc 1073741824 Sep 28 16:16:13 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:14 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc 1073741824" returned: 0 in 0.642s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:14 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc Sep 28 16:16:14 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:14 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc" returned: 0 in 0.342s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:16:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecdf04b9-9dc3-4b89-ad4d-748ce2c098e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ace0b567-276f-44bd-809c-7b881f4032dc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f135570-bccc-4b6d-8c44-aa0f0c879efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:14 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Volume volume-ace0b567-276f-44bd-809c-7b881f4032dc (ace0b567-276f-44bd-809c-7b881f4032dc): created successfully Sep 28 16:16:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f135570-bccc-4b6d-8c44-aa0f0c879efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Flow 'volume_create_manager' (2ddc71ea-4ba1-4fe8-ac59-b0ce500fbb51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:16:14 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-fbcde0e1-0f90-48e8-afd6-f3178564aa90 tempest-VolumesDeleteCascade-1816262167 None] Created volume successfully. Sep 28 16:16:14 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:16:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Flow 'volume_create_manager' (e4f7934f-f842-4592-8c37-cc49f3a46905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:16:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bb6a62-c36b-49a3-afa4-f9cce3bdb7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bb6a62-c36b-49a3-afa4-f9cce3bdb7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0190d1d8-07d9-41c8-98c2-5bad8fe9b4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1535764071f24160becf63384ef8ebdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:16:15Z,use_quota=True,user_id='b4582a6710cb4573afd6d21f47441510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13b90482-d279-4182-82f7-98f6c205b02b),volume_type_id=13b90482-d279-4182-82f7-98f6c205b02b)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (607c7f89-d229-4ff5-916f-b5ab4a0e8e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (607c7f89-d229-4ff5-916f-b5ab4a0e8e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9751af-f5c0-4ba9-be14-f6504f185885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:14 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:16:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9751af-f5c0-4ba9-be14-f6504f185885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0190d1d8-07d9-41c8-98c2-5bad8fe9b4df', 'volume_name': 'volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df', 'volume_size': 1, 'image_id': 'e7701729-149c-4310-ab4a-d37518a95d3e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7701729-149c-4310-ab4a-d37518a95d3e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8d597a8428290fc3e2210b748d15e47d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1535764071f24160becf63384ef8ebdf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8cdb89148eb0d6bfdcab30e6f93224686065634a00badce4680e1050141fc151236892214738f4859616ec78de5b6897b89608379ba294f14cdba605dbebcaa7', 'id': 'e7701729-149c-4310-ab4a-d37518a95d3e', 'created_at': datetime.datetime(2026, 9, 28, 14, 16, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 16, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7701729-149c-4310-ab4a-d37518a95d3e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3962d0ce-d45a-4598-9fd6-4ff08fa419b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3962d0ce-d45a-4598-9fd6-4ff08fa419b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2414bd-8ae1-48af-ba6c-132cf733a806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:15 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Volume 0190d1d8-07d9-41c8-98c2-5bad8fe9b4df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df', 'volume_size': 1, 'image_id': 'e7701729-149c-4310-ab4a-d37518a95d3e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7701729-149c-4310-ab4a-d37518a95d3e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8d597a8428290fc3e2210b748d15e47d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1535764071f24160becf63384ef8ebdf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8cdb89148eb0d6bfdcab30e6f93224686065634a00badce4680e1050141fc151236892214738f4859616ec78de5b6897b89608379ba294f14cdba605dbebcaa7', 'id': 'e7701729-149c-4310-ab4a-d37518a95d3e', 'created_at': datetime.datetime(2026, 9, 28, 14, 16, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 16, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7701729-149c-4310-ab4a-d37518a95d3e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 16:16:15 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Trying to clone 0190d1d8-07d9-41c8-98c2-5bad8fe9b4df from image e7701729-149c-4310-ab4a-d37518a95d3e at location (None, [{'url': 'file:///opt/stack/data/glance/images/e7701729-149c-4310-ab4a-d37518a95d3e', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:16:15 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:16:15 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Image download 0.00 MB at 0.00 MB/s Sep 28 16:16:15 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d751dcd7-f469-41dc-a712-1477f9855835]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:15 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD Sep 28 16:16:15 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-28f810bf-9944-4435-8574-d085075bed70 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-28f810bf-9944-4435-8574-d085075bed70 tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-28f810bf-9944-4435-8574-d085075bed70 tempest-VolumesDeleteCascade-1816262167 None] Creating offline snapshot a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 of volume ace0b567-276f-44bd-809c-7b881f4032dc {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:16:15 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae31afd9-9ac6-4e80-9274-559a322b83cd]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-28f810bf-9944-4435-8574-d085075bed70 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:15 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:15 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc Sep 28 16:16:15 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:16 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD Sep 28 16:16:16 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:16 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-28f810bf-9944-4435-8574-d085075bed70 tempest-VolumesDeleteCascade-1816262167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc" returned: 0 in 0.469s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-28f810bf-9944-4435-8574-d085075bed70 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:16 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 1G Sep 28 16:16:16 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:16 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD" returned: 1 in 0.378s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:16:16 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Temporary image e7701729-149c-4310-ab4a-d37518a95d3e is fetched for user b4582a6710cb4573afd6d21f47441510. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:16:16 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d61f1c7-8e49-4aa2-9d33-b7d2e3dceed6]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:16 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD Sep 28 16:16:16 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:16 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:16 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-28f810bf-9944-4435-8574-d085075bed70 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 1G" returned: 0 in 0.575s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-28f810bf-9944-4435-8574-d085075bed70 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ace0b567-276f-44bd-809c-7b881f4032dc -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:16 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ace0b567-276f-44bd-809c-7b881f4032dc -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 Sep 28 16:16:16 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:16 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD Sep 28 16:16:16 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:17 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-28f810bf-9944-4435-8574-d085075bed70 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ace0b567-276f-44bd-809c-7b881f4032dc -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4" returned: 0 in 0.414s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:17 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-28f810bf-9944-4435-8574-d085075bed70 tempest-VolumesDeleteCascade-1816262167 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 is being set with open permissions: ugo+rw Sep 28 16:16:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-28f810bf-9944-4435-8574-d085075bed70 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:17 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD" returned: 1 in 0.480s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:16:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:17 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 Sep 28 16:16:17 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:17 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-28f810bf-9944-4435-8574-d085075bed70 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4" returned: 0 in 0.444s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-28f810bf-9944-4435-8574-d085075bed70 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:17 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.info Sep 28 16:16:17 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:18 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-28f810bf-9944-4435-8574-d085075bed70 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.info" returned: 0 in 0.481s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:18 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-28f810bf-9944-4435-8574-d085075bed70 tempest-VolumesDeleteCascade-1816262167 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.info is being set with open permissions: ugo+rw Sep 28 16:16:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-28f810bf-9944-4435-8574-d085075bed70 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:18 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.info Sep 28 16:16:18 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:18 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-28f810bf-9944-4435-8574-d085075bed70 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.info" returned: 0 in 0.311s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-28f810bf-9944-4435-8574-d085075bed70 tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.842s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.300s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0190d1d8-07d9-41c8-98c2-5bad8fe9b4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1535764071f24160becf63384ef8ebdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:16:15Z,use_quota=True,user_id='b4582a6710cb4573afd6d21f47441510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13b90482-d279-4182-82f7-98f6c205b02b),volume_type_id=13b90482-d279-4182-82f7-98f6c205b02b)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:16:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Creating volume 0190d1d8-07d9-41c8-98c2-5bad8fe9b4df {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:16:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:16:18 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:16:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:18 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-28f810bf-9944-4435-8574-d085075bed70 tempest-VolumesDeleteCascade-1816262167 None] Create snapshot completed successfully Sep 28 16:16:18 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df 1073741824 Sep 28 16:16:18 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:19 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df 1073741824" returned: 0 in 0.849s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:19 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df Sep 28 16:16:19 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:19 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df" returned: 0 in 0.420s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:16:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:19 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:16:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-8dd5f5f2-4a58-4de1-acc2-30beff1553f1 req-f1329c76-127c-4060-958c-de3325ab68dc tempest-TestMinimumBasicScenario-97209991 None] Terminate volume connection completed successfully. Sep 28 16:16:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-8dd5f5f2-4a58-4de1-acc2-30beff1553f1 req-f1329c76-127c-4060-958c-de3325ab68dc tempest-TestMinimumBasicScenario-97209991 None] Deleting attachment 9330fab3-5e2a-4de0-9b73-a3be1a4e6a0a. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:16:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Flow 'volume_create_manager' (a796d9c1-27cf-479f-9775-351d4aef0663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:16:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb701afe-3975-4ee2-ace2-644b538d65ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:19 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Attempting download of e7701729-149c-4310-ab4a-d37518a95d3e ((None, [{'url': 'file:///opt/stack/data/glance/images/e7701729-149c-4310-ab4a-d37518a95d3e', 'metadata': {}}])) to volume 0190d1d8-07d9-41c8-98c2-5bad8fe9b4df. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb701afe-3975-4ee2-ace2-644b538d65ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-305289379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d452ad-db14-497d-b13c-fce61ef7a511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9195e2725d942038035daacc8acdae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:16:20Z,use_quota=True,user_id='b0ad190c04aa478a9aabcc3c54e59995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb617d9-b7d8-4060-99b5-40f702bed29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb617d9-b7d8-4060-99b5-40f702bed29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c322643b-476e-42f5-9909-f55bd2f1bc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c322643b-476e-42f5-9909-f55bd2f1bc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b4d452ad-db14-497d-b13c-fce61ef7a511', 'volume_name': 'volume-b4d452ad-db14-497d-b13c-fce61ef7a511', 'volume_size': 1, 'snapshot_id': 'a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c72924-fb6d-4de9-a653-92145b1ecea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c72924-fb6d-4de9-a653-92145b1ecea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46e4692-932e-482d-b7cb-1eb9f5bfb20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:20 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Volume b4d452ad-db14-497d-b13c-fce61ef7a511: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b4d452ad-db14-497d-b13c-fce61ef7a511', 'volume_size': 1, 'snapshot_id': 'a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4'} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "cinder-quobyte-a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4-b4d452ad-db14-497d-b13c-fce61ef7a511" by "_create_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c061c64-4c5d-478c-97ab-58d10b1810ac]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7701729-149c-4310-ab4a-d37518a95d3e_m9y_q8cc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4-b4d452ad-db14-497d-b13c-fce61ef7a511" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Creating volume b4d452ad-db14-497d-b13c-fce61ef7a511 from snapshot a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 {{(pid=87087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "cinder-quobyte-b4d452ad-db14-497d-b13c-fce61ef7a511" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-b4d452ad-db14-497d-b13c-fce61ef7a511" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] snapshot: a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4, volume: b4d452ad-db14-497d-b13c-fce61ef7a511, {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:20 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7701729-149c-4310-ab4a-d37518a95d3e_m9y_q8cc Sep 28 16:16:20 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8581497-8e2c-43e3-86e7-d83d87829fcd]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:20 devstack sudo[103057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 Sep 28 16:16:20 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:20 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] Acquiring lock "cinder-85cef08d-f00c-4370-aa76-2fa63526871f-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7701729-149c-4310-ab4a-d37518a95d3e_m9y_q8cc" returned: 0 in 0.419s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7701729-149c-4310-ab4a-d37518a95d3e_m9y_q8cc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] Lock "cinder-85cef08d-f00c-4370-aa76-2fa63526871f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] Acquiring lock "cinder-quobyte-85cef08d-f00c-4370-aa76-2fa63526871f" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] Lock "cinder-quobyte-85cef08d-f00c-4370-aa76-2fa63526871f" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:20 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7701729-149c-4310-ab4a-d37518a95d3e_m9y_q8cc Sep 28 16:16:20 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02cec83-c289-49a4-a61f-2930207ac81c]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-85cef08d-f00c-4370-aa76-2fa63526871f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:20 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-85cef08d-f00c-4370-aa76-2fa63526871f Sep 28 16:16:20 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:20 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4" returned: 0 in 0.558s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ace0b567-276f-44bd-809c-7b881f4032dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef01d72b-2c3c-402f-b945-186e08610126]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:20 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7701729-149c-4310-ab4a-d37518a95d3e_m9y_q8cc" returned: 1 in 0.437s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7701729-149c-4310-ab4a-d37518a95d3e_m9y_q8cc' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47a9551-3e83-48af-9e99-d091dfd7feb4]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:20 devstack sudo[103068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc Sep 28 16:16:20 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:21 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-85cef08d-f00c-4370-aa76-2fa63526871f" returned: 0 in 0.407s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-85cef08d-f00c-4370-aa76-2fa63526871f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:21 devstack sudo[103072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD Sep 28 16:16:21 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:21 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-85cef08d-f00c-4370-aa76-2fa63526871f Sep 28 16:16:21 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:21 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc" returned: 0 in 0.409s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Path /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b4d452ad-db14-497d-b13c-fce61ef7a511 not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b4d452ad-db14-497d-b13c-fce61ef7a511 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:21 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b4d452ad-db14-497d-b13c-fce61ef7a511 Sep 28 16:16:21 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:21 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:21 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-85cef08d-f00c-4370-aa76-2fa63526871f" returned: 0 in 0.318s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] Lock "cinder-quobyte-85cef08d-f00c-4370-aa76-2fa63526871f" released by "delete_volume" :: held 0.787s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] Created reservations ['6eff481c-9d73-46ed-ad13-ed91080bea2a', '3b27a093-b7ec-43c7-8688-a975be76afb0', '5d523e1a-159d-4d69-88bf-6bfb0aee76ed', 'd34fcbc9-114c-4ff9-a1f6-7d81228108aa'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:16:21 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD Sep 28 16:16:21 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:21 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:16:21 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:21 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD" returned: 1 in 0.435s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] e7701729-149c-4310-ab4a-d37518a95d3e was raw, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:21 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df Sep 28 16:16:21 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:21 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.406s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:21 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:16:22 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] Deleted volume successfully. Sep 28 16:16:22 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=97,cinder:SELECT=98,cinder:DELETE=8,cinder:INSERT=22 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:16:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1b26525-d142-4716-a44f-48971cfc2e8c tempest-TestMinimumBasicScenario-97209991 None] Lock "cinder-85cef08d-f00c-4370-aa76-2fa63526871f-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:23 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df" returned: 0 in 1.465s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:23 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e7701729-149c-4310-ab4a-d37518a95d3e_g6g36dd0devstack@QuobyteHD, size 0.00 MB, duration 1.47 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:16:23 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 16:16:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:23 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df 1G Sep 28 16:16:23 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:24 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df 1G" returned: 0 in 1.014s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:24 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Downloaded image e7701729-149c-4310-ab4a-d37518a95d3e ((None, [{'url': 'file:///opt/stack/data/glance/images/e7701729-149c-4310-ab4a-d37518a95d3e', 'metadata': {}}])) to volume 0190d1d8-07d9-41c8-98c2-5bad8fe9b4df successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:16:24 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Temporary image e7701729-149c-4310-ab4a-d37518a95d3e for user b4582a6710cb4573afd6d21f47441510 is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:16:24 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Marking volume 0190d1d8-07d9-41c8-98c2-5bad8fe9b4df as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:16:24 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=92,cinder:INSERT=28,cinder:UPDATE=98,cinder:DELETE=7 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:16:24 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Copying metadata from image e7701729-149c-4310-ab4a-d37518a95d3e to 0190d1d8-07d9-41c8-98c2-5bad8fe9b4df. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:16:24 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Creating volume glance metadata for volume 0190d1d8-07d9-41c8-98c2-5bad8fe9b4df backed by image e7701729-149c-4310-ab4a-d37518a95d3e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e7701729-149c-4310-ab4a-d37518a95d3e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8d597a8428290fc3e2210b748d15e47d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:16:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2414bd-8ae1-48af-ba6c-132cf733a806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df', 'volume_size': 1, 'image_id': 'e7701729-149c-4310-ab4a-d37518a95d3e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7701729-149c-4310-ab4a-d37518a95d3e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8d597a8428290fc3e2210b748d15e47d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1535764071f24160becf63384ef8ebdf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8cdb89148eb0d6bfdcab30e6f93224686065634a00badce4680e1050141fc151236892214738f4859616ec78de5b6897b89608379ba294f14cdba605dbebcaa7', 'id': 'e7701729-149c-4310-ab4a-d37518a95d3e', 'created_at': datetime.datetime(2026, 9, 28, 14, 16, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 16, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7701729-149c-4310-ab4a-d37518a95d3e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31d2460-4313-4d3c-b169-52f455053871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:24 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Volume volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df (0190d1d8-07d9-41c8-98c2-5bad8fe9b4df): created successfully Sep 28 16:16:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31d2460-4313-4d3c-b169-52f455053871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Flow 'volume_create_manager' (e4f7934f-f842-4592-8c37-cc49f3a46905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:16:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2a9d228d-72c8-4ab5-905b-78d404c24c7f tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Created volume successfully. Sep 28 16:16:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Acquiring lock "cinder-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Lock "cinder-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Acquiring lock "cinder-quobyte-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Lock "cinder-quobyte-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df" acquired by "delete_volume" :: waited 0.044s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:25 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada48707-3e92-4901-bbd4-975b8e60757b]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:25 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df Sep 28 16:16:25 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:26 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df" returned: 0 in 1.163s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:26 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df Sep 28 16:16:26 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:27 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df" returned: 0 in 0.770s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Lock "cinder-quobyte-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df" released by "delete_volume" :: held 2.068s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:27 devstack cinder-volume[87087]: WARNING cinder.quota [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:16:27 devstack cinder-volume[87087]: WARNING cinder.quota [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:16:27 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Created reservations ['c78497d1-cce5-445d-89b2-6fa668c1f25d', 'd0c3e752-5032-459e-9c65-9fe38dd7689c', '9e580eff-1212-4871-8a9b-ab3168c272f1', 'ab14af6e-f59b-42f3-9aee-5a8bf62cd788'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:16:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:27 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:16:27 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:28 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.433s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:28 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:16:28 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Deleted volume successfully. Sep 28 16:16:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b4872a0e-1218-4dd5-8b19-6ab65e2e6233 tempest-VolumeAndVolumeTypeFromImageTest-1947507962 None] Lock "cinder-0190d1d8-07d9-41c8-98c2-5bad8fe9b4df-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:31 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b4d452ad-db14-497d-b13c-fce61ef7a511" returned: 0 in 10.136s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:31 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc, size 1024.00 MB, duration 10.14 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b4d452ad-db14-497d-b13c-fce61ef7a511 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:16:31 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Converted 1024.00 MB image at 101.01 MB/s Sep 28 16:16:31 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b4d452ad-db14-497d-b13c-fce61ef7a511 is being set with open permissions: ugo+rw Sep 28 16:16:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b4d452ad-db14-497d-b13c-fce61ef7a511 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:31 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b4d452ad-db14-497d-b13c-fce61ef7a511 Sep 28 16:16:31 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:31 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b4d452ad-db14-497d-b13c-fce61ef7a511" returned: 0 in 0.284s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-b4d452ad-db14-497d-b13c-fce61ef7a511" released by "_copy_volume_from_snapshot" :: held 11.546s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4-b4d452ad-db14-497d-b13c-fce61ef7a511" released by "_create_volume_from_snapshot" :: held 11.645s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.687s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46e4692-932e-482d-b7cb-1eb9f5bfb20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d452ad-db14-497d-b13c-fce61ef7a511', 'volume_size': 1, 'snapshot_id': 'a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f967c6-af1c-4a80-808a-ec68a8afdefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:31 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Volume volume-b4d452ad-db14-497d-b13c-fce61ef7a511 (b4d452ad-db14-497d-b13c-fce61ef7a511): created successfully Sep 28 16:16:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f967c6-af1c-4a80-808a-ec68a8afdefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Flow 'volume_create_manager' (a796d9c1-27cf-479f-9775-351d4aef0663) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:16:31 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-088d538e-e7a7-4cf8-bec8-a15e36577f8f tempest-VolumesDeleteCascade-1816262167 None] Created volume successfully. Sep 28 16:16:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "cinder-ace0b567-276f-44bd-809c-7b881f4032dc-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-ace0b567-276f-44bd-809c-7b881f4032dc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Performing cascade delete. {{(pid=87087) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 16:16:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "cinder-a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "cinder-quobyte-ace0b567-276f-44bd-809c-7b881f4032dc" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-ace0b567-276f-44bd-809c-7b881f4032dc" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "cinder-quobyte-a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Deleting offline snapshot a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 of volume ace0b567-276f-44bd-809c-7b881f4032dc {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:16:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] snapshot_file for this snap is: volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:16:32 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ac1360-6619-4d22-a896-403efaf9053d]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:32 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 Sep 28 16:16:32 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:33 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4" returned: 0 in 0.436s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ace0b567-276f-44bd-809c-7b881f4032dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:16:33 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[560c2938-78ab-4be2-9794-8ac5f969df5a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:33 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc Sep 28 16:16:33 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:34 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc" returned: 0 in 0.852s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:34 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 Sep 28 16:16:34 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:34 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4" returned: 0 in 0.467s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:34 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4 Sep 28 16:16:34 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:34 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc.a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4" returned: 0 in 0.325s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4" released by "_delete_snapshot" :: held 2.212s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-ace0b567-276f-44bd-809c-7b881f4032dc" released by "delete_snapshot" :: held 2.254s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:34 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Created reservations ['48442009-d22b-40e9-b81d-db07ba80472c', '898af404-bef5-423b-9062-fbaeb8c15bca', '8a08e93b-7697-4f5e-b425-9052cf404639', 'bc80be61-c3b9-41df-a2b1-89304dedf5ec'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:35 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:16:35 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:35 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Delete snapshot completed successfully. Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-a21c1e92-09f4-4c0d-96cb-3f3ceed91dc4-delete_snapshot" released by "delete_snapshot" :: held 2.526s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Snapshots deleted, issuing volume delete {{(pid=87087) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "cinder-quobyte-ace0b567-276f-44bd-809c-7b881f4032dc" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-ace0b567-276f-44bd-809c-7b881f4032dc" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[07719fc2-6ca2-4c7e-bad9-8bf54193cc1e]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:35 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc Sep 28 16:16:35 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:35 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.445s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:16:35 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc" returned: 0 in 0.530s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:35 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc Sep 28 16:16:35 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:36 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ace0b567-276f-44bd-809c-7b881f4032dc" returned: 0 in 0.389s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-ace0b567-276f-44bd-809c-7b881f4032dc" released by "delete_volume" :: held 1.008s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:36 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Created reservations ['edafcc31-0493-4cba-aa7d-ec5776d95dd2', '2f5f0ad7-a82e-4c4c-94dc-1ee446d5192d', '4d67196e-c42c-4ddb-84d6-313a46d788f5', 'b9bc07a8-531c-42fa-ba13-3bc004e34926'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:16:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:36 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:16:36 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:36 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.295s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:36 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:16:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Deleted volume successfully. Sep 28 16:16:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-422b37c3-81df-4b33-8320-f719f56e69c3 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-ace0b567-276f-44bd-809c-7b881f4032dc-delete_volume" released by "delete_volume" :: held 4.176s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "cinder-b4d452ad-db14-497d-b13c-fce61ef7a511-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-b4d452ad-db14-497d-b13c-fce61ef7a511-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "cinder-quobyte-b4d452ad-db14-497d-b13c-fce61ef7a511" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-b4d452ad-db14-497d-b13c-fce61ef7a511" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c900efe2-88cc-4b5b-854f-dec33e62d1eb]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b4d452ad-db14-497d-b13c-fce61ef7a511 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:37 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b4d452ad-db14-497d-b13c-fce61ef7a511 Sep 28 16:16:37 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:37 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b4d452ad-db14-497d-b13c-fce61ef7a511" returned: 0 in 0.451s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b4d452ad-db14-497d-b13c-fce61ef7a511 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:37 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b4d452ad-db14-497d-b13c-fce61ef7a511 Sep 28 16:16:37 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:38 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b4d452ad-db14-497d-b13c-fce61ef7a511" returned: 0 in 0.341s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-quobyte-b4d452ad-db14-497d-b13c-fce61ef7a511" released by "delete_volume" :: held 0.848s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:38 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] Created reservations ['f7d37f79-cb45-454f-ae01-8c0dcd2bcf30', '0abd8283-6e3b-40f5-82ea-62cb00dbe31e', 'e9ffec2f-7c04-46e4-9c1a-749bd068d855', '754fb401-e868-4941-a2de-326f3cf1f877'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:16:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:38 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:16:38 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:38 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.342s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:38 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:16:38 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] Deleted volume successfully. Sep 28 16:16:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a4c62cd7-820a-40f4-918b-70331157c3d7 tempest-VolumesDeleteCascade-1816262167 None] Lock "cinder-b4d452ad-db14-497d-b13c-fce61ef7a511-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Flow 'volume_create_manager' (3d7e1e55-35cd-410b-8768-43844cd6e7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339b3ba0-0cd0-4de5-90e1-9bc1438877cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339b3ba0-0cd0-4de5-90e1-9bc1438877cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-223831817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4173c5-c8dc-410a-a9cf-d3d2c31354a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4e763830d14fd3a7c4f3454cfe494e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:16:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:16:45Z,use_quota=True,user_id='667a8c6ca387494e8e9a2b4438a246ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc8de2e-8b13-4881-8267-1dec7176037b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc8de2e-8b13-4881-8267-1dec7176037b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec6198a-0456-47d9-b254-8318164e433d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec6198a-0456-47d9-b254-8318164e433d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc4173c5-c8dc-410a-a9cf-d3d2c31354a5', 'volume_name': 'volume-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5', 'volume_size': 2}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f74a67f8-1d4e-4cf7-b144-a1b7cc2eca13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f74a67f8-1d4e-4cf7-b144-a1b7cc2eca13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70671d9-4639-440c-a025-57224c6cf638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:45 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Volume bc4173c5-c8dc-410a-a9cf-d3d2c31354a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5', 'volume_size': 2} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-223831817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4173c5-c8dc-410a-a9cf-d3d2c31354a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4e763830d14fd3a7c4f3454cfe494e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:16:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:16:45Z,use_quota=True,user_id='667a8c6ca387494e8e9a2b4438a246ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Creating volume bc4173c5-c8dc-410a-a9cf-d3d2c31354a5 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:16:45 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:16:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5 2147483648 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:45 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5 2147483648 Sep 28 16:16:45 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:46 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5 2147483648" returned: 0 in 0.669s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:46 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5 Sep 28 16:16:46 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:46 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5" returned: 0 in 0.370s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:16:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70671d9-4639-440c-a025-57224c6cf638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5', 'volume_size': 2}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b7e140-819c-4367-b324-d5f8534c9f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:46 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Volume volume-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5 (bc4173c5-c8dc-410a-a9cf-d3d2c31354a5): created successfully Sep 28 16:16:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b7e140-819c-4367-b324-d5f8534c9f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Flow 'volume_create_manager' (3d7e1e55-35cd-410b-8768-43844cd6e7d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:16:46 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3abc58e2-7938-471f-89fc-d9d8adcc1def tempest-VolumesCloneNegativeTest-172168978 None] Created volume successfully. Sep 28 16:16:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] Acquiring lock "cinder-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] Lock "cinder-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] Acquiring lock "cinder-quobyte-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] Lock "cinder-quobyte-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:47 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5921f2b-d595-4b78-8e45-120d2e7afbfe]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:48 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5 Sep 28 16:16:48 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:48 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5" returned: 0 in 0.502s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:48 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5 Sep 28 16:16:48 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:48 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5" returned: 0 in 0.305s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] Lock "cinder-quobyte-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5" released by "delete_volume" :: held 0.886s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:48 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] Created reservations ['084166dc-356b-4cd3-a7c6-ec05e49cedaf', '6a9391e1-9a45-40e3-a137-454497317074', '8dce1e09-8ca0-48d8-82d7-c494b3db64ec', '4520413e-f7cb-4c87-818e-b59de0e154b7'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:16:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:49 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:16:49 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:49 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.437s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:49 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:16:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] Deleted volume successfully. Sep 28 16:16:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e8362e08-5e65-4f85-b93d-fab4e537d50a tempest-VolumesCloneNegativeTest-172168978 None] Lock "cinder-bc4173c5-c8dc-410a-a9cf-d3d2c31354a5-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:59 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=33,cinder:INSERT=16,cinder:UPDATE=45,cinder:DELETE=4 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:16:59 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:INSERT=15,cinder:SELECT=35,cinder:UPDATE=44,cinder:DELETE=3 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Flow 'volume_create_manager' (813b846d-5572-4b4e-b603-fbc1da3d8f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47bb0ac-3811-4d3b-ab23-27cdf8e68153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47bb0ac-3811-4d3b-ab23-27cdf8e68153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-773396755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2c917a-4244-4252-8aba-8d9b9e016d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d88b6fa8971436c928dc838164835f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:17:12Z,use_quota=True,user_id='f32cd3431a64465ba7b1111f4bc21999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e29bad-fa83-481a-a9c2-361103ceb673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e29bad-fa83-481a-a9c2-361103ceb673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25d9a7d-da82-4372-98bc-ed2a6133e2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25d9a7d-da82-4372-98bc-ed2a6133e2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b2c917a-4244-4252-8aba-8d9b9e016d63', 'volume_name': 'volume-3b2c917a-4244-4252-8aba-8d9b9e016d63', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fa192a-2348-4439-b866-d7e7e00e1906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fa192a-2348-4439-b866-d7e7e00e1906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49cd2af0-8368-45b4-ab1c-1f1d4ca7a047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:12 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Volume 3b2c917a-4244-4252-8aba-8d9b9e016d63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b2c917a-4244-4252-8aba-8d9b9e016d63', 'volume_size': 1} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-773396755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2c917a-4244-4252-8aba-8d9b9e016d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d88b6fa8971436c928dc838164835f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:17:12Z,use_quota=True,user_id='f32cd3431a64465ba7b1111f4bc21999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Creating volume 3b2c917a-4244-4252-8aba-8d9b9e016d63 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:17:12 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:17:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:12 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 1073741824 Sep 28 16:17:12 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:13 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 1073741824" returned: 0 in 0.806s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:13 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 Sep 28 16:17:13 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:13 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63" returned: 0 in 0.315s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:17:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49cd2af0-8368-45b4-ab1c-1f1d4ca7a047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b2c917a-4244-4252-8aba-8d9b9e016d63', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b7d7b3-189d-45a2-b06b-203b6d7bcf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:13 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Volume volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 (3b2c917a-4244-4252-8aba-8d9b9e016d63): created successfully Sep 28 16:17:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b7d7b3-189d-45a2-b06b-203b6d7bcf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Flow 'volume_create_manager' (813b846d-5572-4b4e-b603-fbc1da3d8f01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:13 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2c0dfff8-86b1-492a-96ef-090bf82c97c5 tempest-SnapshotDependencyTests-962764089 None] Created volume successfully. Sep 28 16:17:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d2d6fe71-a6d9-48b6-a8b6-df213dc34661 tempest-SnapshotDependencyTests-962764089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d2d6fe71-a6d9-48b6-a8b6-df213dc34661 tempest-SnapshotDependencyTests-962764089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d2d6fe71-a6d9-48b6-a8b6-df213dc34661 tempest-SnapshotDependencyTests-962764089 None] Creating offline snapshot ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 of volume 3b2c917a-4244-4252-8aba-8d9b9e016d63 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:17:14 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[08770538-c774-4ba4-a877-932f81bb770e]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d2d6fe71-a6d9-48b6-a8b6-df213dc34661 tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:14 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 Sep 28 16:17:14 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:15 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d2d6fe71-a6d9-48b6-a8b6-df213dc34661 tempest-SnapshotDependencyTests-962764089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63" returned: 0 in 0.554s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d2d6fe71-a6d9-48b6-a8b6-df213dc34661 tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:15 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 1G Sep 28 16:17:15 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:16 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d2d6fe71-a6d9-48b6-a8b6-df213dc34661 tempest-SnapshotDependencyTests-962764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 1G" returned: 0 in 0.699s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d2d6fe71-a6d9-48b6-a8b6-df213dc34661 tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:16 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 Sep 28 16:17:16 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:16 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d2d6fe71-a6d9-48b6-a8b6-df213dc34661 tempest-SnapshotDependencyTests-962764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54" returned: 0 in 0.386s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:16 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-d2d6fe71-a6d9-48b6-a8b6-df213dc34661 tempest-SnapshotDependencyTests-962764089 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 is being set with open permissions: ugo+rw Sep 28 16:17:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d2d6fe71-a6d9-48b6-a8b6-df213dc34661 tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:16 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 Sep 28 16:17:16 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:16 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d2d6fe71-a6d9-48b6-a8b6-df213dc34661 tempest-SnapshotDependencyTests-962764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54" returned: 0 in 0.385s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d2d6fe71-a6d9-48b6-a8b6-df213dc34661 tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:16 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.info Sep 28 16:17:16 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:17 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d2d6fe71-a6d9-48b6-a8b6-df213dc34661 tempest-SnapshotDependencyTests-962764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.info" returned: 0 in 0.437s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:17 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-d2d6fe71-a6d9-48b6-a8b6-df213dc34661 tempest-SnapshotDependencyTests-962764089 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.info is being set with open permissions: ugo+rw Sep 28 16:17:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d2d6fe71-a6d9-48b6-a8b6-df213dc34661 tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:17 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.info Sep 28 16:17:17 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:17 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d2d6fe71-a6d9-48b6-a8b6-df213dc34661 tempest-SnapshotDependencyTests-962764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.info" returned: 0 in 0.381s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d2d6fe71-a6d9-48b6-a8b6-df213dc34661 tempest-SnapshotDependencyTests-962764089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.977s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:17 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d2d6fe71-a6d9-48b6-a8b6-df213dc34661 tempest-SnapshotDependencyTests-962764089 None] Create snapshot completed successfully Sep 28 16:17:18 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:17:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Flow 'volume_create_manager' (ee72759f-b23b-4a6d-b77e-d91ae9178406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7766e03c-9610-4fe3-9c3b-61037b34f481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7766e03c-9610-4fe3-9c3b-61037b34f481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce77247-8fa6-412e-9771-0dc0c271b6dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d88b6fa8971436c928dc838164835f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:17:19Z,use_quota=True,user_id='f32cd3431a64465ba7b1111f4bc21999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05277338-7101-4bef-b26d-40d3348a2bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05277338-7101-4bef-b26d-40d3348a2bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3704f897-a382-4cdb-8665-c0176114bd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3704f897-a382-4cdb-8665-c0176114bd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6ce77247-8fa6-412e-9771-0dc0c271b6dc', 'volume_name': 'volume-6ce77247-8fa6-412e-9771-0dc0c271b6dc', 'volume_size': 1, 'snapshot_id': 'ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab57851-d8c8-4bf8-8915-b985efdd48bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab57851-d8c8-4bf8-8915-b985efdd48bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b3cb5d-a45b-4539-9ce8-25ddb9f2c987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:19 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Volume 6ce77247-8fa6-412e-9771-0dc0c271b6dc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6ce77247-8fa6-412e-9771-0dc0c271b6dc', 'volume_size': 1, 'snapshot_id': 'ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54'} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Acquiring lock "cinder-quobyte-ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54-6ce77247-8fa6-412e-9771-0dc0c271b6dc" by "_create_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Lock "cinder-quobyte-ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54-6ce77247-8fa6-412e-9771-0dc0c271b6dc" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Creating volume 6ce77247-8fa6-412e-9771-0dc0c271b6dc from snapshot ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 {{(pid=87087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Acquiring lock "cinder-quobyte-6ce77247-8fa6-412e-9771-0dc0c271b6dc" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Lock "cinder-quobyte-6ce77247-8fa6-412e-9771-0dc0c271b6dc" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] snapshot: ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54, volume: 6ce77247-8fa6-412e-9771-0dc0c271b6dc, {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[375e2500-ae58-4d2b-ae49-d5c0f5b9e599]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:19 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 Sep 28 16:17:19 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:19 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54" returned: 0 in 0.512s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b2c917a-4244-4252-8aba-8d9b9e016d63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcde16a5-3eb7-4434-8204-7ebd83c0a565]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:19 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 Sep 28 16:17:19 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:20 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63" returned: 0 in 0.490s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:17:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:17:20 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Path /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6ce77247-8fa6-412e-9771-0dc0c271b6dc not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:17:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6ce77247-8fa6-412e-9771-0dc0c271b6dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:20 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6ce77247-8fa6-412e-9771-0dc0c271b6dc Sep 28 16:17:20 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Flow 'volume_create_manager' (63a4f510-4485-4b78-9d55-edd714ec2222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ada2508-3bca-4024-bad6-68c27fc44410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ada2508-3bca-4024-bad6-68c27fc44410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-257553033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b630f55b-1a97-421c-b3ff-ea64dc0452c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e3f442bf0854d1a8692c725fa734088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:17:28Z,use_quota=True,user_id='37b43333bb0f4cd29d4d32cf92bfc4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (251432fe-86f9-4b5c-8619-27f78f413ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (251432fe-86f9-4b5c-8619-27f78f413ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aed4144-8189-457b-8965-3e115d32627a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aed4144-8189-457b-8965-3e115d32627a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b630f55b-1a97-421c-b3ff-ea64dc0452c5', 'volume_name': 'volume-b630f55b-1a97-421c-b3ff-ea64dc0452c5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (916326be-446d-4453-909b-f196f138c73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (916326be-446d-4453-909b-f196f138c73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d755e5-c655-47ca-a94c-8f1c8c420bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:28 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Volume b630f55b-1a97-421c-b3ff-ea64dc0452c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b630f55b-1a97-421c-b3ff-ea64dc0452c5', 'volume_size': 1} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Flow 'volume_create_manager' (dcadb980-8e07-4b7c-8e6f-27dde83385b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773e7d66-2574-445d-8d3f-43fbf8972ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773e7d66-2574-445d-8d3f-43fbf8972ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-521218365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=603051d9-c306-42cb-9037-17ab89753276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e3f442bf0854d1a8692c725fa734088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:17:29Z,use_quota=True,user_id='37b43333bb0f4cd29d4d32cf92bfc4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (208dcd73-c06c-47d2-b521-23967bb956ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (208dcd73-c06c-47d2-b521-23967bb956ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562ab6cb-40cb-42b6-a339-37eb0f004ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562ab6cb-40cb-42b6-a339-37eb0f004ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '603051d9-c306-42cb-9037-17ab89753276', 'volume_name': 'volume-603051d9-c306-42cb-9037-17ab89753276', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af554e69-428d-4c5c-a6bd-6f516da99db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af554e69-428d-4c5c-a6bd-6f516da99db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9218f7-a8c7-4fbc-9673-9b1f1835cda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:29 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Volume 603051d9-c306-42cb-9037-17ab89753276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-603051d9-c306-42cb-9037-17ab89753276', 'volume_size': 1} Sep 28 16:17:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:29 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6ce77247-8fa6-412e-9771-0dc0c271b6dc" returned: 0 in 9.589s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:29 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63, size 1024.00 MB, duration 9.59 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6ce77247-8fa6-412e-9771-0dc0c271b6dc {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:17:29 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Converted 1024.00 MB image at 106.77 MB/s Sep 28 16:17:29 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6ce77247-8fa6-412e-9771-0dc0c271b6dc is being set with open permissions: ugo+rw Sep 28 16:17:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6ce77247-8fa6-412e-9771-0dc0c271b6dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:29 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6ce77247-8fa6-412e-9771-0dc0c271b6dc Sep 28 16:17:29 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:30 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6ce77247-8fa6-412e-9771-0dc0c271b6dc" returned: 0 in 0.376s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Lock "cinder-quobyte-6ce77247-8fa6-412e-9771-0dc0c271b6dc" released by "_copy_volume_from_snapshot" :: held 11.114s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Lock "cinder-quobyte-ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54-6ce77247-8fa6-412e-9771-0dc0c271b6dc" released by "_create_volume_from_snapshot" :: held 11.229s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.270s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.031s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-257553033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b630f55b-1a97-421c-b3ff-ea64dc0452c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e3f442bf0854d1a8692c725fa734088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:17:28Z,use_quota=True,user_id='37b43333bb0f4cd29d4d32cf92bfc4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:17:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Creating volume b630f55b-1a97-421c-b3ff-ea64dc0452c5 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:17:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:17:30 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:17:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b630f55b-1a97-421c-b3ff-ea64dc0452c5 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:30 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b630f55b-1a97-421c-b3ff-ea64dc0452c5 1073741824 Sep 28 16:17:30 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b3cb5d-a45b-4539-9ce8-25ddb9f2c987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce77247-8fa6-412e-9771-0dc0c271b6dc', 'volume_size': 1, 'snapshot_id': 'ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223bd885-2563-4d87-a76d-473bc645f60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:30 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Volume volume-6ce77247-8fa6-412e-9771-0dc0c271b6dc (6ce77247-8fa6-412e-9771-0dc0c271b6dc): created successfully Sep 28 16:17:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223bd885-2563-4d87-a76d-473bc645f60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Flow 'volume_create_manager' (ee72759f-b23b-4a6d-b77e-d91ae9178406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-76ae7aa1-8912-4ba0-9e3b-4f98cb481c57 tempest-SnapshotDependencyTests-962764089 None] Created volume successfully. Sep 28 16:17:31 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b630f55b-1a97-421c-b3ff-ea64dc0452c5 1073741824" returned: 0 in 0.730s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b630f55b-1a97-421c-b3ff-ea64dc0452c5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:31 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b630f55b-1a97-421c-b3ff-ea64dc0452c5 Sep 28 16:17:31 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] Acquiring lock "cinder-ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] Lock "cinder-ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] Acquiring lock "cinder-quobyte-3b2c917a-4244-4252-8aba-8d9b9e016d63" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b630f55b-1a97-421c-b3ff-ea64dc0452c5" returned: 0 in 0.477s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:17:31 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] Lock "cinder-quobyte-3b2c917a-4244-4252-8aba-8d9b9e016d63" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] Acquiring lock "cinder-quobyte-ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.640s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-521218365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=603051d9-c306-42cb-9037-17ab89753276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e3f442bf0854d1a8692c725fa734088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:17:29Z,use_quota=True,user_id='37b43333bb0f4cd29d4d32cf92bfc4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Creating volume 603051d9-c306-42cb-9037-17ab89753276 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:17:31 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-603051d9-c306-42cb-9037-17ab89753276 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:31 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-603051d9-c306-42cb-9037-17ab89753276 1073741824 Sep 28 16:17:31 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d755e5-c655-47ca-a94c-8f1c8c420bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b630f55b-1a97-421c-b3ff-ea64dc0452c5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a5127f-4115-4ec8-ae20-58d8e11af1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] Lock "cinder-quobyte-ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54" acquired by "_delete_snapshot" :: waited 0.135s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] Deleting offline snapshot ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 of volume 3b2c917a-4244-4252-8aba-8d9b9e016d63 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] snapshot_file for this snap is: volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:17:31 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Volume volume-b630f55b-1a97-421c-b3ff-ea64dc0452c5 (b630f55b-1a97-421c-b3ff-ea64dc0452c5): created successfully Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a5127f-4115-4ec8-ae20-58d8e11af1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Flow 'volume_create_manager' (63a4f510-4485-4b78-9d55-edd714ec2222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfb1013-9560-4941-9627-0c57d5975c8b]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:31 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-05efc311-a467-4e9d-a528-a96e8c2edcad tempest-TestServerVolumeAttachmentScenario-1275268814 None] Created volume successfully. Sep 28 16:17:32 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 Sep 28 16:17:32 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:32 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-603051d9-c306-42cb-9037-17ab89753276 1073741824" returned: 0 in 0.730s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-603051d9-c306-42cb-9037-17ab89753276 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:32 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-603051d9-c306-42cb-9037-17ab89753276 Sep 28 16:17:32 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:32 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54" returned: 0 in 0.757s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b2c917a-4244-4252-8aba-8d9b9e016d63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:17:32 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e325dd-80cd-40d0-bc61-db25e7544392]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:32 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-603051d9-c306-42cb-9037-17ab89753276" returned: 0 in 0.402s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:17:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9218f7-a8c7-4fbc-9673-9b1f1835cda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-603051d9-c306-42cb-9037-17ab89753276', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:32 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 Sep 28 16:17:32 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74805427-8a72-4b58-a5a3-18a22d46526a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:32 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Volume volume-603051d9-c306-42cb-9037-17ab89753276 (603051d9-c306-42cb-9037-17ab89753276): created successfully Sep 28 16:17:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74805427-8a72-4b58-a5a3-18a22d46526a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Flow 'volume_create_manager' (dcadb980-8e07-4b7c-8e6f-27dde83385b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-edf952c0-2d2c-44a3-85f9-8d82e36a294c tempest-TestServerVolumeAttachmentScenario-1275268814 None] Created volume successfully. Sep 28 16:17:33 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63" returned: 0 in 0.766s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:33 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 Sep 28 16:17:33 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:34 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54" returned: 0 in 0.610s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:34 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54 Sep 28 16:17:34 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:34 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63.ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54" returned: 0 in 0.357s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] Lock "cinder-quobyte-ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54" released by "_delete_snapshot" :: held 2.716s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] Lock "cinder-quobyte-3b2c917a-4244-4252-8aba-8d9b9e016d63" released by "delete_snapshot" :: held 2.868s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:34 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] Created reservations ['ea706475-75d3-4168-9d80-c9b57eb4a5e4', '58194149-2053-49ab-b7ff-631f1861dd93', '0464464c-510d-41e9-b2de-43d27da6b682', '8cea16cb-bf56-49b4-8819-d96a2b83d712'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:17:34 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] Delete snapshot completed successfully. Sep 28 16:17:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-798b69a4-20c8-4529-978e-02d179427b7c tempest-SnapshotDependencyTests-962764089 None] Lock "cinder-ee3fcb5e-865e-4ec1-ae8a-1922a30f8a54-delete_snapshot" released by "delete_snapshot" :: held 3.090s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] Acquiring lock "cinder-3b2c917a-4244-4252-8aba-8d9b9e016d63-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] Lock "cinder-3b2c917a-4244-4252-8aba-8d9b9e016d63-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] Acquiring lock "cinder-quobyte-3b2c917a-4244-4252-8aba-8d9b9e016d63" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:17:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] Lock "cinder-quobyte-3b2c917a-4244-4252-8aba-8d9b9e016d63" acquired by "delete_volume" :: waited 0.042s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:35 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:17:35 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:35 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ffcec6-8012-45d9-a52d-196d60fc5854]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:35 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 Sep 28 16:17:35 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:35 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.457s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:17:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:17:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:17:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:17:35 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63" returned: 0 in 0.575s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:35 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63 Sep 28 16:17:35 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:36 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3b2c917a-4244-4252-8aba-8d9b9e016d63" returned: 0 in 0.343s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] Lock "cinder-quobyte-3b2c917a-4244-4252-8aba-8d9b9e016d63" released by "delete_volume" :: held 1.029s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:36 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] Created reservations ['3edb1f9e-263c-4526-a33e-5d53be9bb948', '32f39d84-d64b-4f11-bdb3-5611f98262d0', '362b7dfa-2c11-4a03-aebc-3132a7336d60', '2073f1b6-208a-41b4-9511-3d494839a9c1'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:17:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:36 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:17:36 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:36 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.322s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:36 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:17:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] Deleted volume successfully. Sep 28 16:17:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd88c893-8af7-458d-993b-18c02c5bd241 tempest-SnapshotDependencyTests-962764089 None] Lock "cinder-3b2c917a-4244-4252-8aba-8d9b9e016d63-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] Acquiring lock "cinder-6ce77247-8fa6-412e-9771-0dc0c271b6dc-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] Lock "cinder-6ce77247-8fa6-412e-9771-0dc0c271b6dc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] Acquiring lock "cinder-quobyte-6ce77247-8fa6-412e-9771-0dc0c271b6dc" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] Lock "cinder-quobyte-6ce77247-8fa6-412e-9771-0dc0c271b6dc" acquired by "delete_volume" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c553b961-f904-4aa8-8c50-67503a30526e]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6ce77247-8fa6-412e-9771-0dc0c271b6dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:37 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6ce77247-8fa6-412e-9771-0dc0c271b6dc Sep 28 16:17:37 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:37 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6ce77247-8fa6-412e-9771-0dc0c271b6dc" returned: 0 in 0.550s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6ce77247-8fa6-412e-9771-0dc0c271b6dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:38 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6ce77247-8fa6-412e-9771-0dc0c271b6dc Sep 28 16:17:38 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:38 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6ce77247-8fa6-412e-9771-0dc0c271b6dc" returned: 0 in 0.436s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] Lock "cinder-quobyte-6ce77247-8fa6-412e-9771-0dc0c271b6dc" released by "delete_volume" :: held 1.066s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:38 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] Created reservations ['a67725d6-020a-43dd-a6cd-cf8ac1210993', 'a9493e1f-7347-4da1-ad70-1478a9217057', 'ec3098d9-e4ea-46ca-92b2-800d61d45891', '2ea96426-eee4-4dd3-911e-2c89342f883d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:17:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:38 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:17:38 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:39 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.441s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:39 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:17:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] Deleted volume successfully. Sep 28 16:17:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-da0d582b-9708-4b4f-9d56-7ff1e65c4ba6 tempest-SnapshotDependencyTests-962764089 None] Lock "cinder-6ce77247-8fa6-412e-9771-0dc0c271b6dc-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:48 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=32,cinder:UPDATE=35,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:17:49 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=25,cinder:UPDATE=35,cinder:DELETE=5,cinder:INSERT=7 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:18:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-9f13a98c-d10f-46ff-b251-bc85a65eb5a1 req-2995a0e1-b103-4d1d-ade4-741226d24ab0 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-9f13a98c-d10f-46ff-b251-bc85a65eb5a1 req-2995a0e1-b103-4d1d-ade4-741226d24ab0 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-9f13a98c-d10f-46ff-b251-bc85a65eb5a1 req-2995a0e1-b103-4d1d-ade4-741226d24ab0 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-9f13a98c-d10f-46ff-b251-bc85a65eb5a1 req-2995a0e1-b103-4d1d-ade4-741226d24ab0 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-b630f55b-1a97-421c-b3ff-ea64dc0452c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '530456a8-a8fa-474a-aa32-60b18684be95', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:18:13 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-9f13a98c-d10f-46ff-b251-bc85a65eb5a1 req-2995a0e1-b103-4d1d-ade4-741226d24ab0 tempest-TestServerVolumeAttachmentScenario-1275268814 None] attachment_update completed successfully. Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Flow 'volume_create_manager' (827e6095-356e-4ef1-9012-8275c17f34e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e17b1b-4dd6-44da-b928-36649dbdc3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e17b1b-4dd6-44da-b928-36649dbdc3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-577159767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=668f7e8c-766d-4f17-9301-9a753351dabb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f50203e1ce5841709eba684f92fdac07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:15Z,use_quota=True,user_id='e2d80036e6be4c8d989c53cc04de59c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dedc73dc-dcac-4ac1-bb13-c5f20cb498f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dedc73dc-dcac-4ac1-bb13-c5f20cb498f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a4aae3-4d4a-4306-90da-20ae4b47859a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a4aae3-4d4a-4306-90da-20ae4b47859a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '668f7e8c-766d-4f17-9301-9a753351dabb', 'volume_name': 'volume-668f7e8c-766d-4f17-9301-9a753351dabb', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde118cd-a5f6-4e60-b6ad-f962b653e88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde118cd-a5f6-4e60-b6ad-f962b653e88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a69287-b7c5-43cb-9772-6a7c2cb5c9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:15 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Volume 668f7e8c-766d-4f17-9301-9a753351dabb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-668f7e8c-766d-4f17-9301-9a753351dabb', 'volume_size': 1} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-577159767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=668f7e8c-766d-4f17-9301-9a753351dabb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f50203e1ce5841709eba684f92fdac07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:15Z,use_quota=True,user_id='e2d80036e6be4c8d989c53cc04de59c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Creating volume 668f7e8c-766d-4f17-9301-9a753351dabb {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:15 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:18:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-668f7e8c-766d-4f17-9301-9a753351dabb 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:15 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-668f7e8c-766d-4f17-9301-9a753351dabb 1073741824 Sep 28 16:18:15 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:16 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-668f7e8c-766d-4f17-9301-9a753351dabb 1073741824" returned: 0 in 0.508s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-668f7e8c-766d-4f17-9301-9a753351dabb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:16 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-668f7e8c-766d-4f17-9301-9a753351dabb Sep 28 16:18:16 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:16 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-668f7e8c-766d-4f17-9301-9a753351dabb" returned: 0 in 0.271s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a69287-b7c5-43cb-9772-6a7c2cb5c9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-668f7e8c-766d-4f17-9301-9a753351dabb', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abf2840-ae50-4c11-8994-7febf913a43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:16 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Volume volume-668f7e8c-766d-4f17-9301-9a753351dabb (668f7e8c-766d-4f17-9301-9a753351dabb): created successfully Sep 28 16:18:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abf2840-ae50-4c11-8994-7febf913a43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Flow 'volume_create_manager' (827e6095-356e-4ef1-9012-8275c17f34e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:16 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-46443387-c3c0-47a9-af75-fa3e51de3314 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Created volume successfully. Sep 28 16:18:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-82023d63-3eb9-490d-9d48-1f4dbd85427d req-35c463c7-e3b7-4cb4-8a4d-a0fc31b8ae3e tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-82023d63-3eb9-490d-9d48-1f4dbd85427d req-35c463c7-e3b7-4cb4-8a4d-a0fc31b8ae3e tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-82023d63-3eb9-490d-9d48-1f4dbd85427d req-35c463c7-e3b7-4cb4-8a4d-a0fc31b8ae3e tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-82023d63-3eb9-490d-9d48-1f4dbd85427d req-35c463c7-e3b7-4cb4-8a4d-a0fc31b8ae3e tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-668f7e8c-766d-4f17-9301-9a753351dabb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f09233c2-f31b-4716-8e84-64a86e3b7c23', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:18:18 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-82023d63-3eb9-490d-9d48-1f4dbd85427d req-35c463c7-e3b7-4cb4-8a4d-a0fc31b8ae3e tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] attachment_update completed successfully. Sep 28 16:18:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-6e221ef0-d3c0-4a10-b3cb-8aa02eae2060 req-76ecd12d-cbe6-481d-b909-92a0c1a8d1a1 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-6e221ef0-d3c0-4a10-b3cb-8aa02eae2060 req-76ecd12d-cbe6-481d-b909-92a0c1a8d1a1 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-6e221ef0-d3c0-4a10-b3cb-8aa02eae2060 req-76ecd12d-cbe6-481d-b909-92a0c1a8d1a1 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-6e221ef0-d3c0-4a10-b3cb-8aa02eae2060 req-76ecd12d-cbe6-481d-b909-92a0c1a8d1a1 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-603051d9-c306-42cb-9037-17ab89753276', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56e4d42d-87bb-4b5e-90dc-e653d1c58c5a', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:18:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-6e221ef0-d3c0-4a10-b3cb-8aa02eae2060 req-76ecd12d-cbe6-481d-b909-92a0c1a8d1a1 tempest-TestServerVolumeAttachmentScenario-1275268814 None] attachment_update completed successfully. Sep 28 16:18:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-d0a5e86f-3372-44c3-b6eb-7c7353a1464a req-35a69483-12b0-4a22-ace3-6f5d6710ec10 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Terminate volume connection completed successfully. Sep 28 16:18:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-d0a5e86f-3372-44c3-b6eb-7c7353a1464a req-35a69483-12b0-4a22-ace3-6f5d6710ec10 tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Deleting attachment f09233c2-f31b-4716-8e84-64a86e3b7c23. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:18:22 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-423904e3-139c-4486-baab-d0ebafb8cea5 req-d0c7905f-a947-4b82-a355-d664d1bbcbc5 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Terminate volume connection completed successfully. Sep 28 16:18:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-423904e3-139c-4486-baab-d0ebafb8cea5 req-d0c7905f-a947-4b82-a355-d664d1bbcbc5 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Deleting attachment 56e4d42d-87bb-4b5e-90dc-e653d1c58c5a. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:18:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Acquiring lock "cinder-668f7e8c-766d-4f17-9301-9a753351dabb-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Lock "cinder-668f7e8c-766d-4f17-9301-9a753351dabb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Acquiring lock "cinder-quobyte-668f7e8c-766d-4f17-9301-9a753351dabb" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Lock "cinder-quobyte-668f7e8c-766d-4f17-9301-9a753351dabb" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:22 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0f88b0-b0c5-451e-85df-874f1f8e8e5f]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-668f7e8c-766d-4f17-9301-9a753351dabb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:22 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-668f7e8c-766d-4f17-9301-9a753351dabb Sep 28 16:18:22 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:23 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-668f7e8c-766d-4f17-9301-9a753351dabb" returned: 0 in 0.432s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-668f7e8c-766d-4f17-9301-9a753351dabb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:23 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-668f7e8c-766d-4f17-9301-9a753351dabb Sep 28 16:18:23 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:23 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-668f7e8c-766d-4f17-9301-9a753351dabb" returned: 0 in 0.298s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Lock "cinder-quobyte-668f7e8c-766d-4f17-9301-9a753351dabb" released by "delete_volume" :: held 0.782s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:23 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Created reservations ['3161c78f-00b7-4412-9883-8be2fcfdb28b', '31e592b8-d7a2-45c1-8360-57b8c3a8331d', '961cae77-ff9c-4f6e-aca1-8d7e53ecaf3c', '9ee68464-23a1-4344-9aa1-5aca5173ddba'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:18:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:23 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:18:23 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:23 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.305s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:23 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:18:23 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Deleted volume successfully. Sep 28 16:18:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-797b694f-1b6d-4dd0-8b7d-ce2543e46e7a tempest-TestServerVolumeAttachScenarioOldVersion-983796554 None] Lock "cinder-668f7e8c-766d-4f17-9301-9a753351dabb-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:23 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-7da7f282-d062-4c1b-bea9-2bcaf433f839 req-07a92af0-e1eb-4bc7-9a8e-86d1f1674494 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Terminate volume connection completed successfully. Sep 28 16:18:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-7da7f282-d062-4c1b-bea9-2bcaf433f839 req-07a92af0-e1eb-4bc7-9a8e-86d1f1674494 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Deleting attachment 530456a8-a8fa-474a-aa32-60b18684be95. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:18:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Acquiring lock "cinder-603051d9-c306-42cb-9037-17ab89753276-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "cinder-603051d9-c306-42cb-9037-17ab89753276-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Acquiring lock "cinder-quobyte-603051d9-c306-42cb-9037-17ab89753276" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "cinder-quobyte-603051d9-c306-42cb-9037-17ab89753276" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:30 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb63aeb-5716-4040-a5bc-e722a6a5a2e0]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-603051d9-c306-42cb-9037-17ab89753276 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:30 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-603051d9-c306-42cb-9037-17ab89753276 Sep 28 16:18:30 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:30 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-603051d9-c306-42cb-9037-17ab89753276" returned: 0 in 0.449s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-603051d9-c306-42cb-9037-17ab89753276 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:30 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-603051d9-c306-42cb-9037-17ab89753276 Sep 28 16:18:30 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:30 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-603051d9-c306-42cb-9037-17ab89753276" returned: 0 in 0.257s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "cinder-quobyte-603051d9-c306-42cb-9037-17ab89753276" released by "delete_volume" :: held 0.763s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:30 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Created reservations ['0d6f386e-446e-4a20-81ea-9eda036273a2', 'a107a438-c292-4905-82d4-2d0cd565de25', 'e592359b-762a-4fd2-add5-945d0c20d0dc', 'bbfd37b0-7cda-4bac-834f-b08af61a458e'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:18:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:31 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:18:31 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Acquiring lock "cinder-b630f55b-1a97-421c-b3ff-ea64dc0452c5-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "cinder-b630f55b-1a97-421c-b3ff-ea64dc0452c5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Acquiring lock "cinder-quobyte-b630f55b-1a97-421c-b3ff-ea64dc0452c5" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "cinder-quobyte-b630f55b-1a97-421c-b3ff-ea64dc0452c5" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:31 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.322s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:31 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:18:31 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Deleted volume successfully. Sep 28 16:18:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1cdd22-e46c-4b56-97fa-32532a109e19]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b630f55b-1a97-421c-b3ff-ea64dc0452c5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-103ab66d-580b-47d6-8713-9b0a3743bfc7 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "cinder-603051d9-c306-42cb-9037-17ab89753276-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:31 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b630f55b-1a97-421c-b3ff-ea64dc0452c5 Sep 28 16:18:31 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:31 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b630f55b-1a97-421c-b3ff-ea64dc0452c5" returned: 0 in 0.447s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b630f55b-1a97-421c-b3ff-ea64dc0452c5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:31 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b630f55b-1a97-421c-b3ff-ea64dc0452c5 Sep 28 16:18:31 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:32 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b630f55b-1a97-421c-b3ff-ea64dc0452c5" returned: 0 in 0.256s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "cinder-quobyte-b630f55b-1a97-421c-b3ff-ea64dc0452c5" released by "delete_volume" :: held 0.759s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:32 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Created reservations ['0a1a08bc-5cde-4ad0-8957-c3d01136d6c1', '3d14d9e7-929a-4f04-beaf-52b699a68f9c', '7cd22b3b-9ae8-4f5a-bb5a-9fd4798bf6e7', 'bf887891-f30a-423f-bb99-326789e205c3'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:18:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:32 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:18:32 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:32 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.309s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:32 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:18:32 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Deleted volume successfully. Sep 28 16:18:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-01b029db-9be8-4936-a3cc-185e6eb48706 tempest-TestServerVolumeAttachmentScenario-1275268814 None] Lock "cinder-b630f55b-1a97-421c-b3ff-ea64dc0452c5-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:18:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:35 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:18:35 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:35 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.287s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:18:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:18:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:18:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:18:42 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=41,cinder:UPDATE=35,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:18:42 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=39,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Flow 'volume_create_manager' (13625ec3-6c8c-4278-b234-a6335f70c9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7e7872-c84a-4c52-81a1-23615f71c050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7e7872-c84a-4c52-81a1-23615f71c050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2066292428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa5bcab-8e97-4ca0-8350-1cc156a38472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42576241f39649168c746cb1b5ecc533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:47Z,use_quota=True,user_id='c614e2e5a164429e84b94f5942e26ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9db649-9538-4ee0-8ecb-0b5cb7e8d649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9db649-9538-4ee0-8ecb-0b5cb7e8d649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4eacd9-9cbf-471b-975d-91596222806f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4eacd9-9cbf-471b-975d-91596222806f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fa5bcab-8e97-4ca0-8350-1cc156a38472', 'volume_name': 'volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48aaab2-0a77-4e5b-99b0-659d1dbbecea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48aaab2-0a77-4e5b-99b0-659d1dbbecea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c15a543-2765-4b9e-ba3b-1c760a715a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Volume 8fa5bcab-8e97-4ca0-8350-1cc156a38472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472', 'volume_size': 1} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2066292428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa5bcab-8e97-4ca0-8350-1cc156a38472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42576241f39649168c746cb1b5ecc533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:47Z,use_quota=True,user_id='c614e2e5a164429e84b94f5942e26ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Creating volume 8fa5bcab-8e97-4ca0-8350-1cc156a38472 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:47 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:18:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:47 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 1073741824 Sep 28 16:18:47 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:48 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 1073741824" returned: 0 in 0.613s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:48 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 Sep 28 16:18:48 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:48 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472" returned: 0 in 0.280s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c15a543-2765-4b9e-ba3b-1c760a715a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f49262f-4ec8-4685-abcb-66d3d5b90d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:48 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Volume volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 (8fa5bcab-8e97-4ca0-8350-1cc156a38472): created successfully Sep 28 16:18:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f49262f-4ec8-4685-abcb-66d3d5b90d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Flow 'volume_create_manager' (13625ec3-6c8c-4278-b234-a6335f70c9b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:48 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-428301cc-730b-464d-bfa7-38974258f9da tempest-VolumeDependencyTests-1382258005 None] Created volume successfully. Sep 28 16:18:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d99cf5fa-8b81-4afa-b9e8-b5a9ea3e52a3 tempest-VolumeDependencyTests-1382258005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d99cf5fa-8b81-4afa-b9e8-b5a9ea3e52a3 tempest-VolumeDependencyTests-1382258005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d99cf5fa-8b81-4afa-b9e8-b5a9ea3e52a3 tempest-VolumeDependencyTests-1382258005 None] Creating offline snapshot d70c6629-8b45-461a-81be-432e34e8aa98 of volume 8fa5bcab-8e97-4ca0-8350-1cc156a38472 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:18:49 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cbadc5-917b-4e0a-a8b4-73edd3158add]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d99cf5fa-8b81-4afa-b9e8-b5a9ea3e52a3 tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:49 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 Sep 28 16:18:49 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:50 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d99cf5fa-8b81-4afa-b9e8-b5a9ea3e52a3 tempest-VolumeDependencyTests-1382258005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472" returned: 0 in 0.544s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d99cf5fa-8b81-4afa-b9e8-b5a9ea3e52a3 tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:50 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98 1G Sep 28 16:18:50 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:50 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d99cf5fa-8b81-4afa-b9e8-b5a9ea3e52a3 tempest-VolumeDependencyTests-1382258005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98 1G" returned: 0 in 0.614s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d99cf5fa-8b81-4afa-b9e8-b5a9ea3e52a3 tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:51 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98 Sep 28 16:18:51 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:51 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d99cf5fa-8b81-4afa-b9e8-b5a9ea3e52a3 tempest-VolumeDependencyTests-1382258005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98" returned: 0 in 0.358s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:51 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-d99cf5fa-8b81-4afa-b9e8-b5a9ea3e52a3 tempest-VolumeDependencyTests-1382258005 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98 is being set with open permissions: ugo+rw Sep 28 16:18:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d99cf5fa-8b81-4afa-b9e8-b5a9ea3e52a3 tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:51 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98 Sep 28 16:18:51 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:51 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d99cf5fa-8b81-4afa-b9e8-b5a9ea3e52a3 tempest-VolumeDependencyTests-1382258005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98" returned: 0 in 0.309s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d99cf5fa-8b81-4afa-b9e8-b5a9ea3e52a3 tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:51 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.info Sep 28 16:18:51 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:52 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d99cf5fa-8b81-4afa-b9e8-b5a9ea3e52a3 tempest-VolumeDependencyTests-1382258005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.info" returned: 0 in 0.350s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:52 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-d99cf5fa-8b81-4afa-b9e8-b5a9ea3e52a3 tempest-VolumeDependencyTests-1382258005 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.info is being set with open permissions: ugo+rw Sep 28 16:18:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d99cf5fa-8b81-4afa-b9e8-b5a9ea3e52a3 tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:52 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.info Sep 28 16:18:52 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:52 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d99cf5fa-8b81-4afa-b9e8-b5a9ea3e52a3 tempest-VolumeDependencyTests-1382258005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.info" returned: 0 in 0.322s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d99cf5fa-8b81-4afa-b9e8-b5a9ea3e52a3 tempest-VolumeDependencyTests-1382258005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.637s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:52 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d99cf5fa-8b81-4afa-b9e8-b5a9ea3e52a3 tempest-VolumeDependencyTests-1382258005 None] Create snapshot completed successfully Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Flow 'volume_create_manager' (7680f308-ae3d-4129-a137-7e7f6030dd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bf2b5f-449b-44f6-af08-9e5780239546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bf2b5f-449b-44f6-af08-9e5780239546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-268315273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65202feb-c0a3-457e-b6e1-7d46a1fd18df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42576241f39649168c746cb1b5ecc533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d70c6629-8b45-461a-81be-432e34e8aa98,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:54Z,use_quota=True,user_id='c614e2e5a164429e84b94f5942e26ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817ccff7-7fcd-43ee-b875-642a130d2034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817ccff7-7fcd-43ee-b875-642a130d2034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692d1432-a730-435a-92a4-272be3e0ab4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692d1432-a730-435a-92a4-272be3e0ab4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '65202feb-c0a3-457e-b6e1-7d46a1fd18df', 'volume_name': 'volume-65202feb-c0a3-457e-b6e1-7d46a1fd18df', 'volume_size': 1, 'snapshot_id': 'd70c6629-8b45-461a-81be-432e34e8aa98'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a4daf5-1642-4546-8bd3-ca75bcc56666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a4daf5-1642-4546-8bd3-ca75bcc56666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7c00c1-35b6-4c24-9180-99039dfe4c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:53 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Volume 65202feb-c0a3-457e-b6e1-7d46a1fd18df: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-65202feb-c0a3-457e-b6e1-7d46a1fd18df', 'volume_size': 1, 'snapshot_id': 'd70c6629-8b45-461a-81be-432e34e8aa98'} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Acquiring lock "cinder-quobyte-d70c6629-8b45-461a-81be-432e34e8aa98-65202feb-c0a3-457e-b6e1-7d46a1fd18df" by "_create_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Lock "cinder-quobyte-d70c6629-8b45-461a-81be-432e34e8aa98-65202feb-c0a3-457e-b6e1-7d46a1fd18df" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Creating volume 65202feb-c0a3-457e-b6e1-7d46a1fd18df from snapshot d70c6629-8b45-461a-81be-432e34e8aa98 {{(pid=87087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Acquiring lock "cinder-quobyte-65202feb-c0a3-457e-b6e1-7d46a1fd18df" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Lock "cinder-quobyte-65202feb-c0a3-457e-b6e1-7d46a1fd18df" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] snapshot: d70c6629-8b45-461a-81be-432e34e8aa98, volume: 65202feb-c0a3-457e-b6e1-7d46a1fd18df, {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71c93ef-2e1f-42c9-a4ae-20460322a55f]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:53 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98 Sep 28 16:18:54 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:54 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98" returned: 0 in 0.413s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:18:54 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[622e41f9-0c1a-48d6-83ef-8bc1b5e9b16b]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:54 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 Sep 28 16:18:54 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:54 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472" returned: 0 in 0.504s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:18:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:18:54 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Path /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-65202feb-c0a3-457e-b6e1-7d46a1fd18df not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:18:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-65202feb-c0a3-457e-b6e1-7d46a1fd18df {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:54 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-65202feb-c0a3-457e-b6e1-7d46a1fd18df Sep 28 16:18:54 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:03 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-65202feb-c0a3-457e-b6e1-7d46a1fd18df" returned: 0 in 8.337s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:03 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472, size 1024.00 MB, duration 8.34 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-65202feb-c0a3-457e-b6e1-7d46a1fd18df {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:19:03 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Converted 1024.00 MB image at 122.80 MB/s Sep 28 16:19:03 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-65202feb-c0a3-457e-b6e1-7d46a1fd18df is being set with open permissions: ugo+rw Sep 28 16:19:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-65202feb-c0a3-457e-b6e1-7d46a1fd18df {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:03 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-65202feb-c0a3-457e-b6e1-7d46a1fd18df Sep 28 16:19:03 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:03 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-65202feb-c0a3-457e-b6e1-7d46a1fd18df" returned: 0 in 0.272s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Lock "cinder-quobyte-65202feb-c0a3-457e-b6e1-7d46a1fd18df" released by "_copy_volume_from_snapshot" :: held 9.630s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Lock "cinder-quobyte-d70c6629-8b45-461a-81be-432e34e8aa98-65202feb-c0a3-457e-b6e1-7d46a1fd18df" released by "_create_volume_from_snapshot" :: held 9.705s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.721s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7c00c1-35b6-4c24-9180-99039dfe4c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65202feb-c0a3-457e-b6e1-7d46a1fd18df', 'volume_size': 1, 'snapshot_id': 'd70c6629-8b45-461a-81be-432e34e8aa98'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b87fbd-1891-4a73-af41-4ce0f3d098e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:03 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Volume volume-65202feb-c0a3-457e-b6e1-7d46a1fd18df (65202feb-c0a3-457e-b6e1-7d46a1fd18df): created successfully Sep 28 16:19:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b87fbd-1891-4a73-af41-4ce0f3d098e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Flow 'volume_create_manager' (7680f308-ae3d-4129-a137-7e7f6030dd51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-17cf83fa-0007-4c7d-9f2e-fe965bcee9d1 tempest-VolumeDependencyTests-1382258005 None] Created volume successfully. Sep 28 16:19:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] Acquiring lock "cinder-d70c6629-8b45-461a-81be-432e34e8aa98-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] Lock "cinder-d70c6629-8b45-461a-81be-432e34e8aa98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] Acquiring lock "cinder-quobyte-8fa5bcab-8e97-4ca0-8350-1cc156a38472" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] Lock "cinder-quobyte-8fa5bcab-8e97-4ca0-8350-1cc156a38472" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] Acquiring lock "cinder-quobyte-d70c6629-8b45-461a-81be-432e34e8aa98" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] Lock "cinder-quobyte-d70c6629-8b45-461a-81be-432e34e8aa98" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] Deleting offline snapshot d70c6629-8b45-461a-81be-432e34e8aa98 of volume 8fa5bcab-8e97-4ca0-8350-1cc156a38472 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:19:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] snapshot_file for this snap is: volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:19:04 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[34667de1-2ad3-48af-94da-c185c4576756]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:04 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98 Sep 28 16:19:04 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:05 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98" returned: 0 in 0.424s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:19:05 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b075b432-9a89-4870-b322-d392e63c65a5]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:05 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 Sep 28 16:19:05 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:06 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472" returned: 0 in 0.780s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:06 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98 Sep 28 16:19:06 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:06 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98" returned: 0 in 0.382s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:06 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98 Sep 28 16:19:06 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:06 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472.d70c6629-8b45-461a-81be-432e34e8aa98" returned: 0 in 0.273s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] Lock "cinder-quobyte-d70c6629-8b45-461a-81be-432e34e8aa98" released by "_delete_snapshot" :: held 2.003s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] Lock "cinder-quobyte-8fa5bcab-8e97-4ca0-8350-1cc156a38472" released by "delete_snapshot" :: held 2.033s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:06 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] Created reservations ['8e46cd41-6760-47dd-acbe-4403c9e67c53', 'e726be7c-ef41-4ef5-84fc-a74399f08176', '1532f927-a20f-468e-884b-88b5512fe6f8', 'f2e38133-8340-4df0-ae85-985b42dd305b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:06 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] Delete snapshot completed successfully. Sep 28 16:19:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2c6602e1-7b72-4a3d-b444-5c22c9991f32 tempest-VolumeDependencyTests-1382258005 None] Lock "cinder-d70c6629-8b45-461a-81be-432e34e8aa98-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] Acquiring lock "cinder-8fa5bcab-8e97-4ca0-8350-1cc156a38472-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] Lock "cinder-8fa5bcab-8e97-4ca0-8350-1cc156a38472-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] Acquiring lock "cinder-quobyte-8fa5bcab-8e97-4ca0-8350-1cc156a38472" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] Lock "cinder-quobyte-8fa5bcab-8e97-4ca0-8350-1cc156a38472" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:08 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2b8af6-adbe-4ea2-92aa-8cd0a057aab8]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:08 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 Sep 28 16:19:08 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:08 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472" returned: 0 in 0.539s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:08 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472 Sep 28 16:19:08 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:09 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8fa5bcab-8e97-4ca0-8350-1cc156a38472" returned: 0 in 0.367s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] Lock "cinder-quobyte-8fa5bcab-8e97-4ca0-8350-1cc156a38472" released by "delete_volume" :: held 1.019s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:09 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] Created reservations ['3cc5de6a-95d3-45fd-abb4-a0ac5f0586be', '8934af7d-e1d4-4d31-834d-05cd1b6b635a', '31d81c30-5abc-44e8-8f88-14c5ba119ebe', 'a1791e99-f768-4d96-bfdb-af3f6e861884'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:09 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:19:09 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:09 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.340s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:09 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:09 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] Deleted volume successfully. Sep 28 16:19:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-61e2ba4b-feba-48a5-920f-3fbd0772f68f tempest-VolumeDependencyTests-1382258005 None] Lock "cinder-8fa5bcab-8e97-4ca0-8350-1cc156a38472-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] Acquiring lock "cinder-65202feb-c0a3-457e-b6e1-7d46a1fd18df-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] Lock "cinder-65202feb-c0a3-457e-b6e1-7d46a1fd18df-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] Acquiring lock "cinder-quobyte-65202feb-c0a3-457e-b6e1-7d46a1fd18df" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] Lock "cinder-quobyte-65202feb-c0a3-457e-b6e1-7d46a1fd18df" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:10 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[51007569-de06-4efb-b412-459c18653866]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-65202feb-c0a3-457e-b6e1-7d46a1fd18df {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:10 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-65202feb-c0a3-457e-b6e1-7d46a1fd18df Sep 28 16:19:10 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:11 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-65202feb-c0a3-457e-b6e1-7d46a1fd18df" returned: 0 in 0.500s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-65202feb-c0a3-457e-b6e1-7d46a1fd18df {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:11 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-65202feb-c0a3-457e-b6e1-7d46a1fd18df Sep 28 16:19:11 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:11 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-65202feb-c0a3-457e-b6e1-7d46a1fd18df" returned: 0 in 0.327s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] Lock "cinder-quobyte-65202feb-c0a3-457e-b6e1-7d46a1fd18df" released by "delete_volume" :: held 0.896s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:11 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] Created reservations ['027b01b2-f5a1-441a-99b0-91f51f610fc3', '4f47c26e-2e7f-4d76-bb3f-a9a7619469df', 'e30044e2-74e2-42be-a5aa-0e149d5f5f32', 'fe321b72-f855-4ed4-92af-52ea571bce46'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:11 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:19:11 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:11 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.392s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:11 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] Deleted volume successfully. Sep 28 16:19:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-925f00c2-9c2d-4c7a-bf87-35a4a2f1bc16 tempest-VolumeDependencyTests-1382258005 None] Lock "cinder-65202feb-c0a3-457e-b6e1-7d46a1fd18df-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Flow 'volume_create_manager' (2b7d6716-3fb6-4d31-8cd2-4e73ca6b5a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b581bd78-e2bf-4c20-a7c9-f2206dfba0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b581bd78-e2bf-4c20-a7c9-f2206dfba0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd36b73-6ecb-4812-b3be-e15d557b011e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bb9a7d474941289b50d90e8e8a9ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:16Z,use_quota=True,user_id='9624149df4d445459e3ad3dd3b193202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21660295-a4d6-45cf-9de4-b3a887738c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21660295-a4d6-45cf-9de4-b3a887738c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78616fce-e019-486a-8fb1-b817cdf84226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78616fce-e019-486a-8fb1-b817cdf84226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fd36b73-6ecb-4812-b3be-e15d557b011e', 'volume_name': 'volume-6fd36b73-6ecb-4812-b3be-e15d557b011e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4cc9b37-f949-496f-a143-486047bf83bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4cc9b37-f949-496f-a143-486047bf83bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb1b8ff-aeb8-47af-ad14-dce1f60e6179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:15 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Volume 6fd36b73-6ecb-4812-b3be-e15d557b011e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fd36b73-6ecb-4812-b3be-e15d557b011e', 'volume_size': 1} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd36b73-6ecb-4812-b3be-e15d557b011e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bb9a7d474941289b50d90e8e8a9ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:16Z,use_quota=True,user_id='9624149df4d445459e3ad3dd3b193202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Creating volume 6fd36b73-6ecb-4812-b3be-e15d557b011e {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:15 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:19:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6fd36b73-6ecb-4812-b3be-e15d557b011e 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:15 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6fd36b73-6ecb-4812-b3be-e15d557b011e 1073741824 Sep 28 16:19:15 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:16 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6fd36b73-6ecb-4812-b3be-e15d557b011e 1073741824" returned: 0 in 0.519s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6fd36b73-6ecb-4812-b3be-e15d557b011e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:16 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6fd36b73-6ecb-4812-b3be-e15d557b011e Sep 28 16:19:16 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:16 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6fd36b73-6ecb-4812-b3be-e15d557b011e" returned: 0 in 0.327s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb1b8ff-aeb8-47af-ad14-dce1f60e6179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fd36b73-6ecb-4812-b3be-e15d557b011e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb83609-ef67-4803-ac52-c464303e4323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:16 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Volume volume-6fd36b73-6ecb-4812-b3be-e15d557b011e (6fd36b73-6ecb-4812-b3be-e15d557b011e): created successfully Sep 28 16:19:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb83609-ef67-4803-ac52-c464303e4323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Flow 'volume_create_manager' (2b7d6716-3fb6-4d31-8cd2-4e73ca6b5a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:16 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d52c9664-df0d-40ec-8860-774bb402f80c tempest-CinderUnicodeTest-925006114 None] Created volume successfully. Sep 28 16:19:16 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Flow 'volume_create_manager' (06a2b518-8dfc-470d-9adb-8b5a68336264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17beeb4-8695-4fad-ad84-c6765a1ef0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17beeb4-8695-4fad-ad84-c6765a1ef0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1507960989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89f556e-8fc0-44a8-8fcc-3f52b91433e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cefd3b4e39d4ab4b114e1b0c4cf4b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:17Z,use_quota=True,user_id='5b430b4862074a698b85684bf997121e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6321b9a2-1a59-4a54-b9a9-85b725f22fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6321b9a2-1a59-4a54-b9a9-85b725f22fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f08718df-b340-4667-a034-ea1045a535d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:17 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:19:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f08718df-b340-4667-a034-ea1045a535d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e89f556e-8fc0-44a8-8fcc-3f52b91433e2', 'volume_name': 'volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2', 'volume_size': 1, 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3682e9714c0d4e0582fb2ca18f45f417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'created_at': datetime.datetime(2026, 9, 28, 13, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7abc4afd-c71a-462f-b806-ba7da0f478cc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f2ffbf-bbe3-4b76-8b86-c17b6ae0673e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f2ffbf-bbe3-4b76-8b86-c17b6ae0673e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f64240-5afb-4f3b-8266-8dc14e876ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:17 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Volume e89f556e-8fc0-44a8-8fcc-3f52b91433e2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2', 'volume_size': 1, 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3682e9714c0d4e0582fb2ca18f45f417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'created_at': datetime.datetime(2026, 9, 28, 13, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7abc4afd-c71a-462f-b806-ba7da0f478cc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 16:19:17 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Trying to clone e89f556e-8fc0-44a8-8fcc-3f52b91433e2 from image 7abc4afd-c71a-462f-b806-ba7da0f478cc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:19:17 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_9uab6wjjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:19:17 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Image download 20.69 MB at 20.69 MB/s Sep 28 16:19:17 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00ac56f-2c49-430b-ba8f-992b2f7bdd1a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_9uab6wjjdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:17 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_9uab6wjjdevstack@QuobyteHD Sep 28 16:19:17 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:18 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_9uab6wjjdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Temporary image 7abc4afd-c71a-462f-b806-ba7da0f478cc is fetched for user 5b430b4862074a698b85684bf997121e. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3041921-316b-41ad-852f-9dd85288341b]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_9uab6wjjdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:18 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_9uab6wjjdevstack@QuobyteHD Sep 28 16:19:18 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Flow 'volume_create_manager' (51fb87ad-e17b-4e0b-b497-abb23bdb24e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f142fe15-271a-4406-bf83-c3a64a62d721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f142fe15-271a-4406-bf83-c3a64a62d721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1649028549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5417f4a-bf19-4e3d-8913-56664e7c7597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bb9a7d474941289b50d90e8e8a9ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:18Z,use_quota=True,user_id='9624149df4d445459e3ad3dd3b193202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b286ff2-8d23-45fe-94c7-0bf37a904f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b286ff2-8d23-45fe-94c7-0bf37a904f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e3d49e-57d5-4b02-a194-ed651c280041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e3d49e-57d5-4b02-a194-ed651c280041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5417f4a-bf19-4e3d-8913-56664e7c7597', 'volume_name': 'volume-b5417f4a-bf19-4e3d-8913-56664e7c7597', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5a8f10-876b-42b9-bdd8-51ca2a0da6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5a8f10-876b-42b9-bdd8-51ca2a0da6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481ad7d5-dbcc-4615-ae5e-9695dfb6aaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:18 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Volume b5417f4a-bf19-4e3d-8913-56664e7c7597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5417f4a-bf19-4e3d-8913-56664e7c7597', 'volume_size': 1} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1649028549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5417f4a-bf19-4e3d-8913-56664e7c7597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bb9a7d474941289b50d90e8e8a9ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:18Z,use_quota=True,user_id='9624149df4d445459e3ad3dd3b193202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Creating volume b5417f4a-bf19-4e3d-8913-56664e7c7597 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:18 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:18 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597 1073741824 Sep 28 16:19:18 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:18 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_9uab6wjjdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:19 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597 1073741824" returned: 0 in 0.490s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:19 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597 Sep 28 16:19:19 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:19 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597" returned: 0 in 0.251s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.677s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1507960989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89f556e-8fc0-44a8-8fcc-3f52b91433e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cefd3b4e39d4ab4b114e1b0c4cf4b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:17Z,use_quota=True,user_id='5b430b4862074a698b85684bf997121e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Creating volume e89f556e-8fc0-44a8-8fcc-3f52b91433e2 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:19 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481ad7d5-dbcc-4615-ae5e-9695dfb6aaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5417f4a-bf19-4e3d-8913-56664e7c7597', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:19 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2 1073741824 Sep 28 16:19:19 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e170a6a-edbc-4d15-9cce-726f7541779c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:19 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Volume volume-b5417f4a-bf19-4e3d-8913-56664e7c7597 (b5417f4a-bf19-4e3d-8913-56664e7c7597): created successfully Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e170a6a-edbc-4d15-9cce-726f7541779c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Flow 'volume_create_manager' (51fb87ad-e17b-4e0b-b497-abb23bdb24e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f7b6c292-bf1c-441c-8e4d-7847acdaba96 tempest-CinderUnicodeTest-925006114 None] Created volume successfully. Sep 28 16:19:19 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2 1073741824" returned: 0 in 0.459s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:19 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2 Sep 28 16:19:19 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:20 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2" returned: 0 in 0.285s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:20 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Attempting download of 7abc4afd-c71a-462f-b806-ba7da0f478cc ((None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}])) to volume e89f556e-8fc0-44a8-8fcc-3f52b91433e2. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:19:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7479e8ae-800a-4c2c-8e3c-da5cc9dec46f]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_qsim8210 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:20 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_qsim8210 Sep 28 16:19:20 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:20 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_qsim8210" returned: 0 in 0.458s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_qsim8210 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:20 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_qsim8210 Sep 28 16:19:20 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9e24de0f-fe2a-4be9-9e68-dd78d7051c63 tempest-CinderUnicodeTest-925006114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9e24de0f-fe2a-4be9-9e68-dd78d7051c63 tempest-CinderUnicodeTest-925006114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9e24de0f-fe2a-4be9-9e68-dd78d7051c63 tempest-CinderUnicodeTest-925006114 None] Creating offline snapshot 3fdec41a-c6ad-4a73-9648-54ce193662eb of volume b5417f4a-bf19-4e3d-8913-56664e7c7597 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:19:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[693ffa6c-9787-43f3-84fa-fe668e5a11d1]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e24de0f-fe2a-4be9-9e68-dd78d7051c63 tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:21 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597 Sep 28 16:19:21 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:21 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_qsim8210" returned: 1 in 0.447s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7abc4afd-c71a-462f-b806-ba7da0f478cc_qsim8210' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:19:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[56eb2d3f-6e59-4de6-a89c-c6ab49cc2e66]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_9uab6wjjdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:21 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_9uab6wjjdevstack@QuobyteHD Sep 28 16:19:21 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:21 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e24de0f-fe2a-4be9-9e68-dd78d7051c63 tempest-CinderUnicodeTest-925006114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597" returned: 0 in 0.430s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e24de0f-fe2a-4be9-9e68-dd78d7051c63 tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:21 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb 1G Sep 28 16:19:21 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:21 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_9uab6wjjdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:21 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] 7abc4afd-c71a-462f-b806-ba7da0f478cc was qcow2, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:19:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_9uab6wjjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:21 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_9uab6wjjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2 Sep 28 16:19:21 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:21 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e24de0f-fe2a-4be9-9e68-dd78d7051c63 tempest-CinderUnicodeTest-925006114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb 1G" returned: 0 in 0.480s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e24de0f-fe2a-4be9-9e68-dd78d7051c63 tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5417f4a-bf19-4e3d-8913-56664e7c7597 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:21 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5417f4a-bf19-4e3d-8913-56664e7c7597 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb Sep 28 16:19:21 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:22 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e24de0f-fe2a-4be9-9e68-dd78d7051c63 tempest-CinderUnicodeTest-925006114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5417f4a-bf19-4e3d-8913-56664e7c7597 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb" returned: 0 in 0.365s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:22 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-9e24de0f-fe2a-4be9-9e68-dd78d7051c63 tempest-CinderUnicodeTest-925006114 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb is being set with open permissions: ugo+rw Sep 28 16:19:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e24de0f-fe2a-4be9-9e68-dd78d7051c63 tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:22 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb Sep 28 16:19:22 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:22 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e24de0f-fe2a-4be9-9e68-dd78d7051c63 tempest-CinderUnicodeTest-925006114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb" returned: 0 in 0.360s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e24de0f-fe2a-4be9-9e68-dd78d7051c63 tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:22 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.info Sep 28 16:19:22 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:23 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e24de0f-fe2a-4be9-9e68-dd78d7051c63 tempest-CinderUnicodeTest-925006114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.info" returned: 0 in 0.400s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:23 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-9e24de0f-fe2a-4be9-9e68-dd78d7051c63 tempest-CinderUnicodeTest-925006114 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.info is being set with open permissions: ugo+rw Sep 28 16:19:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e24de0f-fe2a-4be9-9e68-dd78d7051c63 tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:23 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.info Sep 28 16:19:23 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:23 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9e24de0f-fe2a-4be9-9e68-dd78d7051c63 tempest-CinderUnicodeTest-925006114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.info" returned: 0 in 0.301s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9e24de0f-fe2a-4be9-9e68-dd78d7051c63 tempest-CinderUnicodeTest-925006114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.456s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:23 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9e24de0f-fe2a-4be9-9e68-dd78d7051c63 tempest-CinderUnicodeTest-925006114 None] Create snapshot completed successfully Sep 28 16:19:23 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_9uab6wjjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2" returned: 0 in 2.283s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:23 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7abc4afd-c71a-462f-b806-ba7da0f478cc_9uab6wjjdevstack@QuobyteHD, size 112.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:19:23 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Converted 112.00 MB image at 49.04 MB/s Sep 28 16:19:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:23 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2 1G Sep 28 16:19:23 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] Acquiring lock "cinder-3fdec41a-c6ad-4a73-9648-54ce193662eb-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:24 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] Lock "cinder-3fdec41a-c6ad-4a73-9648-54ce193662eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] Acquiring lock "cinder-quobyte-b5417f4a-bf19-4e3d-8913-56664e7c7597" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2 1G" returned: 0 in 0.404s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Downloaded image 7abc4afd-c71a-462f-b806-ba7da0f478cc ((None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}])) to volume e89f556e-8fc0-44a8-8fcc-3f52b91433e2 successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Temporary image 7abc4afd-c71a-462f-b806-ba7da0f478cc for user 5b430b4862074a698b85684bf997121e is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Marking volume e89f556e-8fc0-44a8-8fcc-3f52b91433e2 as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] Lock "cinder-quobyte-b5417f4a-bf19-4e3d-8913-56664e7c7597" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] Acquiring lock "cinder-quobyte-3fdec41a-c6ad-4a73-9648-54ce193662eb" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Copying metadata from image 7abc4afd-c71a-462f-b806-ba7da0f478cc to e89f556e-8fc0-44a8-8fcc-3f52b91433e2. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Creating volume glance metadata for volume e89f556e-8fc0-44a8-8fcc-3f52b91433e2 backed by image 7abc4afd-c71a-462f-b806-ba7da0f478cc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] Lock "cinder-quobyte-3fdec41a-c6ad-4a73-9648-54ce193662eb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] Deleting offline snapshot 3fdec41a-c6ad-4a73-9648-54ce193662eb of volume b5417f4a-bf19-4e3d-8913-56664e7c7597 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] snapshot_file for this snap is: volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6909b7-9122-4bfb-a6d9-ce0f33663c3d]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f64240-5afb-4f3b-8266-8dc14e876ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2', 'volume_size': 1, 'image_id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7abc4afd-c71a-462f-b806-ba7da0f478cc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3682e9714c0d4e0582fb2ca18f45f417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7abc4afd-c71a-462f-b806-ba7da0f478cc', 'created_at': datetime.datetime(2026, 9, 28, 13, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7abc4afd-c71a-462f-b806-ba7da0f478cc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6309635-cfc7-47aa-9e5a-0c7ece4472ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:24 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Volume volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2 (e89f556e-8fc0-44a8-8fcc-3f52b91433e2): created successfully Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6309635-cfc7-47aa-9e5a-0c7ece4472ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Flow 'volume_create_manager' (06a2b518-8dfc-470d-9adb-8b5a68336264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f3d91228-c333-4e2c-80ec-2a4c18685f55 tempest-TestShelveInstance-1353089502 None] Created volume successfully. Sep 28 16:19:24 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb Sep 28 16:19:24 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:24 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb" returned: 0 in 0.452s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5417f4a-bf19-4e3d-8913-56664e7c7597(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c31a29-eb6f-43fc-87e6-2cc64052adc2]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:24 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597 Sep 28 16:19:24 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:25 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597" returned: 0 in 0.411s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:25 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb Sep 28 16:19:25 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:25 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb" returned: 0 in 0.403s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:25 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb Sep 28 16:19:25 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:25 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597.3fdec41a-c6ad-4a73-9648-54ce193662eb" returned: 0 in 0.283s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] Lock "cinder-quobyte-3fdec41a-c6ad-4a73-9648-54ce193662eb" released by "_delete_snapshot" :: held 1.697s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] Lock "cinder-quobyte-b5417f4a-bf19-4e3d-8913-56664e7c7597" released by "delete_snapshot" :: held 1.728s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:26 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] Created reservations ['92379995-77fb-4dd3-a418-c4f1e81d1f50', '47aef67a-9340-4cb8-95ce-ebe96ec11625', 'dee5e43c-e43b-4582-bbee-65b5d9910052', '9e0e0fba-857b-44f8-bccf-05a32b341262'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] Delete snapshot completed successfully. Sep 28 16:19:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8cfa5df1-7742-4a58-9eb4-786eef95b334 tempest-CinderUnicodeTest-925006114 None] Lock "cinder-3fdec41a-c6ad-4a73-9648-54ce193662eb-delete_snapshot" released by "delete_snapshot" :: held 1.942s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] Acquiring lock "cinder-b5417f4a-bf19-4e3d-8913-56664e7c7597-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] Lock "cinder-b5417f4a-bf19-4e3d-8913-56664e7c7597-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] Acquiring lock "cinder-quobyte-b5417f4a-bf19-4e3d-8913-56664e7c7597" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] Lock "cinder-quobyte-b5417f4a-bf19-4e3d-8913-56664e7c7597" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:26 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cb3d69-41da-4381-ac0e-eb149e2731d8]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:26 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597 Sep 28 16:19:26 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:27 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597" returned: 0 in 0.513s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:27 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597 Sep 28 16:19:27 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:27 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b5417f4a-bf19-4e3d-8913-56664e7c7597" returned: 0 in 0.353s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] Lock "cinder-quobyte-b5417f4a-bf19-4e3d-8913-56664e7c7597" released by "delete_volume" :: held 0.963s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:27 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] Created reservations ['e25122d8-02f5-4097-9553-2f7b3c6b71c3', 'dcc69fa8-f25a-4694-81dc-ff3a50936011', 'fd08855f-eb5f-4f44-8f4e-8039399d90a2', 'bf584ef7-6b71-4031-a3c7-a08386ec4b4c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:27 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:19:27 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:27 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.305s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:27 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] Deleted volume successfully. Sep 28 16:19:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-73085a9a-2fc9-43f9-8aea-8c018625bdae tempest-CinderUnicodeTest-925006114 None] Lock "cinder-b5417f4a-bf19-4e3d-8913-56664e7c7597-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] Acquiring lock "cinder-6fd36b73-6ecb-4812-b3be-e15d557b011e-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] Lock "cinder-6fd36b73-6ecb-4812-b3be-e15d557b011e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] Acquiring lock "cinder-quobyte-6fd36b73-6ecb-4812-b3be-e15d557b011e" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] Lock "cinder-quobyte-6fd36b73-6ecb-4812-b3be-e15d557b011e" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:28 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed38b53a-e50d-42a7-805f-7e6af0d06603]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6fd36b73-6ecb-4812-b3be-e15d557b011e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-d22566f4-8d6e-458d-b269-66916ef19036 req-f82a896a-849a-4f49-901c-34a89fcd1503 tempest-TestShelveInstance-1353089502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-d22566f4-8d6e-458d-b269-66916ef19036 req-f82a896a-849a-4f49-901c-34a89fcd1503 tempest-TestShelveInstance-1353089502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-d22566f4-8d6e-458d-b269-66916ef19036 req-f82a896a-849a-4f49-901c-34a89fcd1503 tempest-TestShelveInstance-1353089502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:29 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6fd36b73-6ecb-4812-b3be-e15d557b011e Sep 28 16:19:29 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-d22566f4-8d6e-458d-b269-66916ef19036 req-f82a896a-849a-4f49-901c-34a89fcd1503 tempest-TestShelveInstance-1353089502 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e05fafff-5b96-482d-a633-5ce8e46c107e', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:19:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-d22566f4-8d6e-458d-b269-66916ef19036 req-f82a896a-849a-4f49-901c-34a89fcd1503 tempest-TestShelveInstance-1353089502 None] attachment_update completed successfully. Sep 28 16:19:29 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6fd36b73-6ecb-4812-b3be-e15d557b011e" returned: 0 in 0.549s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6fd36b73-6ecb-4812-b3be-e15d557b011e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:29 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6fd36b73-6ecb-4812-b3be-e15d557b011e Sep 28 16:19:29 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:29 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6fd36b73-6ecb-4812-b3be-e15d557b011e" returned: 0 in 0.362s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] Lock "cinder-quobyte-6fd36b73-6ecb-4812-b3be-e15d557b011e" released by "delete_volume" :: held 0.991s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:29 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] Created reservations ['0ce2f347-3188-4197-8397-3e06b8f77bdc', '5d9a1e3c-aba6-4d2f-a7b6-9f45adb1af7f', '8a6bd8e9-fb83-46a3-ba02-ef3a33dfb482', 'fd1957fc-ae17-4e36-a3cf-4edadb68ff01'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:30 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:19:30 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:30 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.262s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:30 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] Deleted volume successfully. Sep 28 16:19:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-83ff6295-47b5-43af-8aa6-d6b2889be36a tempest-CinderUnicodeTest-925006114 None] Lock "cinder-6fd36b73-6ecb-4812-b3be-e15d557b011e-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:19:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:35 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:19:35 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:35 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.366s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:19:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:19:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Flow 'volume_create_manager' (42592502-2856-4998-97d0-6a776cf4ca7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbced264-b4ab-4bf0-96aa-06a427726580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbced264-b4ab-4bf0-96aa-06a427726580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1576285749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cefd1830-b74f-47ce-b1ce-8f699bbc81cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff2f76fffc84ae69b9190379ed06481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:36Z,use_quota=True,user_id='af1380aa197049ac98cfa3c4efe0d0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738c31ae-fa03-4e18-b3ea-550d70484653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738c31ae-fa03-4e18-b3ea-550d70484653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf21b684-860a-48ef-bdc6-55887e58bcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf21b684-860a-48ef-bdc6-55887e58bcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cefd1830-b74f-47ce-b1ce-8f699bbc81cd', 'volume_name': 'volume-cefd1830-b74f-47ce-b1ce-8f699bbc81cd', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58126dce-67ed-47ac-b832-b0051e47a61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58126dce-67ed-47ac-b832-b0051e47a61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd724fa-2aad-4cd8-9215-525cbaa4fd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:36 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Volume cefd1830-b74f-47ce-b1ce-8f699bbc81cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cefd1830-b74f-47ce-b1ce-8f699bbc81cd', 'volume_size': 1} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1576285749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cefd1830-b74f-47ce-b1ce-8f699bbc81cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff2f76fffc84ae69b9190379ed06481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:36Z,use_quota=True,user_id='af1380aa197049ac98cfa3c4efe0d0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Creating volume cefd1830-b74f-47ce-b1ce-8f699bbc81cd {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:36 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:19:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cefd1830-b74f-47ce-b1ce-8f699bbc81cd 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:36 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cefd1830-b74f-47ce-b1ce-8f699bbc81cd 1073741824 Sep 28 16:19:36 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:37 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cefd1830-b74f-47ce-b1ce-8f699bbc81cd 1073741824" returned: 0 in 0.651s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cefd1830-b74f-47ce-b1ce-8f699bbc81cd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:37 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cefd1830-b74f-47ce-b1ce-8f699bbc81cd Sep 28 16:19:37 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:37 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cefd1830-b74f-47ce-b1ce-8f699bbc81cd" returned: 0 in 0.334s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd724fa-2aad-4cd8-9215-525cbaa4fd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cefd1830-b74f-47ce-b1ce-8f699bbc81cd', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ead987-5f57-4fb4-8b37-3e93af6d6308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:37 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Volume volume-cefd1830-b74f-47ce-b1ce-8f699bbc81cd (cefd1830-b74f-47ce-b1ce-8f699bbc81cd): created successfully Sep 28 16:19:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ead987-5f57-4fb4-8b37-3e93af6d6308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Flow 'volume_create_manager' (42592502-2856-4998-97d0-6a776cf4ca7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3e26b0eb-936f-474d-aaf7-2b83d5e6ab27 tempest-ProjectReaderTests-750100040 None] Created volume successfully. Sep 28 16:19:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] Acquiring lock "cinder-cefd1830-b74f-47ce-b1ce-8f699bbc81cd-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] Lock "cinder-cefd1830-b74f-47ce-b1ce-8f699bbc81cd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] Acquiring lock "cinder-quobyte-cefd1830-b74f-47ce-b1ce-8f699bbc81cd" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] Lock "cinder-quobyte-cefd1830-b74f-47ce-b1ce-8f699bbc81cd" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:38 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2d151f-8db7-47c1-9400-12b9efbf78b2]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cefd1830-b74f-47ce-b1ce-8f699bbc81cd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:38 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cefd1830-b74f-47ce-b1ce-8f699bbc81cd Sep 28 16:19:38 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:39 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cefd1830-b74f-47ce-b1ce-8f699bbc81cd" returned: 0 in 0.523s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cefd1830-b74f-47ce-b1ce-8f699bbc81cd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:39 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cefd1830-b74f-47ce-b1ce-8f699bbc81cd Sep 28 16:19:39 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:39 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cefd1830-b74f-47ce-b1ce-8f699bbc81cd" returned: 0 in 0.338s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] Lock "cinder-quobyte-cefd1830-b74f-47ce-b1ce-8f699bbc81cd" released by "delete_volume" :: held 0.926s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:39 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] Created reservations ['af28044c-bdb3-4b68-a184-4e76ac3e2e2f', '29cf387f-7dc3-4df4-98d6-1d42f4563a48', '54612fc3-3e1a-4ef8-a6e3-27ee1e391d08', '7361ebe0-0b6f-4328-87cc-264808aee14e'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:39 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:19:39 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:40 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.320s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:40 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:40 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] Deleted volume successfully. Sep 28 16:19:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ba46479-7a55-4648-a860-b454cd4ee09a tempest-ProjectReaderTests-750100040 None] Lock "cinder-cefd1830-b74f-47ce-b1ce-8f699bbc81cd-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Flow 'volume_create_manager' (968ae15f-c46d-4403-9ba9-ed57067eec11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266e5c57-8224-43cf-98d0-b1c4d0f348c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266e5c57-8224-43cf-98d0-b1c4d0f348c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341458384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378a81af-ba56-4003-a1e3-9f85f7bcaa9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff2f76fffc84ae69b9190379ed06481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:42Z,use_quota=True,user_id='af1380aa197049ac98cfa3c4efe0d0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b211e199-0d39-4090-b622-7c74a56d30bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b211e199-0d39-4090-b622-7c74a56d30bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3f9d37-f584-4e46-8b4d-d45737b4194f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3f9d37-f584-4e46-8b4d-d45737b4194f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '378a81af-ba56-4003-a1e3-9f85f7bcaa9f', 'volume_name': 'volume-378a81af-ba56-4003-a1e3-9f85f7bcaa9f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af59b55f-4799-4a18-8c63-bd0803171580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af59b55f-4799-4a18-8c63-bd0803171580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d8eabd-ed7e-4f3e-a3e9-f17e4e0203c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:41 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Volume 378a81af-ba56-4003-a1e3-9f85f7bcaa9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-378a81af-ba56-4003-a1e3-9f85f7bcaa9f', 'volume_size': 1} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341458384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378a81af-ba56-4003-a1e3-9f85f7bcaa9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff2f76fffc84ae69b9190379ed06481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:42Z,use_quota=True,user_id='af1380aa197049ac98cfa3c4efe0d0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Creating volume 378a81af-ba56-4003-a1e3-9f85f7bcaa9f {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:41 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:19:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-378a81af-ba56-4003-a1e3-9f85f7bcaa9f 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:41 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-378a81af-ba56-4003-a1e3-9f85f7bcaa9f 1073741824 Sep 28 16:19:41 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:42 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-378a81af-ba56-4003-a1e3-9f85f7bcaa9f 1073741824" returned: 0 in 0.466s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-378a81af-ba56-4003-a1e3-9f85f7bcaa9f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:42 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-378a81af-ba56-4003-a1e3-9f85f7bcaa9f Sep 28 16:19:42 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:42 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-378a81af-ba56-4003-a1e3-9f85f7bcaa9f" returned: 0 in 0.301s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:42 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=68,cinder:INSERT=25,cinder:UPDATE=71,cinder:DELETE=3 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:19:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d8eabd-ed7e-4f3e-a3e9-f17e4e0203c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-378a81af-ba56-4003-a1e3-9f85f7bcaa9f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca0f817-8f86-493e-802b-c519f639f944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:42 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Volume volume-378a81af-ba56-4003-a1e3-9f85f7bcaa9f (378a81af-ba56-4003-a1e3-9f85f7bcaa9f): created successfully Sep 28 16:19:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca0f817-8f86-493e-802b-c519f639f944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Flow 'volume_create_manager' (968ae15f-c46d-4403-9ba9-ed57067eec11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e42cdf48-1545-417f-bd10-292ea3c690fb tempest-ProjectReaderTests-750100040 None] Created volume successfully. Sep 28 16:19:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] Acquiring lock "cinder-378a81af-ba56-4003-a1e3-9f85f7bcaa9f-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] Lock "cinder-378a81af-ba56-4003-a1e3-9f85f7bcaa9f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:43 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=85,cinder:SELECT=78,cinder:DELETE=11,cinder:INSERT=25 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:19:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] Acquiring lock "cinder-quobyte-378a81af-ba56-4003-a1e3-9f85f7bcaa9f" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] Lock "cinder-quobyte-378a81af-ba56-4003-a1e3-9f85f7bcaa9f" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:43 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f30599-587a-4a11-89e3-2cd1a80311cf]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-378a81af-ba56-4003-a1e3-9f85f7bcaa9f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:43 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-378a81af-ba56-4003-a1e3-9f85f7bcaa9f Sep 28 16:19:43 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:44 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-378a81af-ba56-4003-a1e3-9f85f7bcaa9f" returned: 0 in 0.399s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-378a81af-ba56-4003-a1e3-9f85f7bcaa9f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:44 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-378a81af-ba56-4003-a1e3-9f85f7bcaa9f Sep 28 16:19:44 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:44 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-378a81af-ba56-4003-a1e3-9f85f7bcaa9f" returned: 0 in 0.255s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] Lock "cinder-quobyte-378a81af-ba56-4003-a1e3-9f85f7bcaa9f" released by "delete_volume" :: held 0.714s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:44 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] Created reservations ['de929729-4f3f-4fd7-9023-07bb9f63f788', '515fc913-0997-450f-895c-46748e16e574', '341a72bf-7ff4-424c-b8bf-791a57832bc2', '912c5cdd-14f7-477e-a86b-8205c43e6f48'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:44 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:19:44 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:44 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.265s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:44 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:44 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] Deleted volume successfully. Sep 28 16:19:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bb769205-cc02-4825-8620-f75cb5ca2ed2 tempest-ProjectReaderTests-750100040 None] Lock "cinder-378a81af-ba56-4003-a1e3-9f85f7bcaa9f-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:54 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=11,cinder:SELECT=4,cinder:INSERT=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:19:54 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:19:54 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Flow 'volume_create_manager' (4ee0e92c-72d9-4292-941f-69bf139e6fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d5d4884-6d6a-4501-9712-4983117a2a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d5d4884-6d6a-4501-9712-4983117a2a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-153045237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6131ca6a227c47f79026e0ad84e454bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:55Z,use_quota=True,user_id='1a89753a1c6d436199bc085f525d8fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f5312f-d505-4d96-bd7a-4250c5978201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f5312f-d505-4d96-bd7a-4250c5978201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67fda97-c10e-4202-a09a-0821f0015d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67fda97-c10e-4202-a09a-0821f0015d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4', 'volume_name': 'volume-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f329f691-cd1d-47d8-9408-31cd0542be2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f329f691-cd1d-47d8-9408-31cd0542be2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3046111-f3be-4150-9209-7ea514213995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:55 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Volume 7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4', 'volume_size': 1} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-153045237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6131ca6a227c47f79026e0ad84e454bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:55Z,use_quota=True,user_id='1a89753a1c6d436199bc085f525d8fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Creating volume 7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:55 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:55 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4 1073741824 Sep 28 16:19:55 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:55 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4 1073741824" returned: 0 in 0.468s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:55 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4 Sep 28 16:19:55 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:55 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4" returned: 0 in 0.269s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3046111-f3be-4150-9209-7ea514213995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7660b3cd-254b-4465-b24f-21e227862870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:55 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Volume volume-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4 (7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4): created successfully Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7660b3cd-254b-4465-b24f-21e227862870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Flow 'volume_create_manager' (4ee0e92c-72d9-4292-941f-69bf139e6fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:55 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6b909487-3f9d-48a5-9120-4e04380e8bf3 tempest-ProjectReaderTests-2116297773 None] Created volume successfully. Sep 28 16:19:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] Acquiring lock "cinder-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] Lock "cinder-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] Acquiring lock "cinder-quobyte-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] Lock "cinder-quobyte-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:57 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[98521dc6-9e16-407e-aeea-f8dacdec0ce0]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:57 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4 Sep 28 16:19:57 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:57 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4" returned: 0 in 0.403s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:57 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4 Sep 28 16:19:57 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:57 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4" returned: 0 in 0.261s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] Lock "cinder-quobyte-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4" released by "delete_volume" :: held 0.713s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] Created reservations ['0a0d1cd2-f211-4e21-8fcb-04773ae9f2ec', 'd451dce7-585a-4a13-a20b-3ad2d1482626', '2ba89239-df0b-4df3-97f0-5bbb1c3c3718', '95f71aeb-c076-425f-a695-dbfe32d6ba1c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:58 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:19:58 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:58 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.256s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] Deleted volume successfully. Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3b07f52a-ef84-44fd-82d4-b9129f77ea88 tempest-ProjectReaderTests-2116297773 None] Lock "cinder-7b2c98c2-f2fb-41f9-b53f-6b68ce6ab0c4-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Flow 'volume_create_manager' (99633baf-3c61-484a-9376-d541d23fff1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f660e3-69af-4bff-865d-11c6f90b0f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f660e3-69af-4bff-865d-11c6f90b0f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1966693558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301a17e4-5fee-44c1-8227-83408fce7bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6131ca6a227c47f79026e0ad84e454bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:59Z,use_quota=True,user_id='1a89753a1c6d436199bc085f525d8fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758380df-63d9-4f10-aa0a-879ce8b4b9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758380df-63d9-4f10-aa0a-879ce8b4b9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d592b4-12c2-4829-ba30-0327e6508b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d592b4-12c2-4829-ba30-0327e6508b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '301a17e4-5fee-44c1-8227-83408fce7bc5', 'volume_name': 'volume-301a17e4-5fee-44c1-8227-83408fce7bc5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a11051-4711-451c-92fb-80ae2fa72ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a11051-4711-451c-92fb-80ae2fa72ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d033bb3-8bbd-4291-b3f9-41854dce9340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:59 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Volume 301a17e4-5fee-44c1-8227-83408fce7bc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-301a17e4-5fee-44c1-8227-83408fce7bc5', 'volume_size': 1} Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1966693558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301a17e4-5fee-44c1-8227-83408fce7bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6131ca6a227c47f79026e0ad84e454bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:59Z,use_quota=True,user_id='1a89753a1c6d436199bc085f525d8fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Creating volume 301a17e4-5fee-44c1-8227-83408fce7bc5 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:59 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-301a17e4-5fee-44c1-8227-83408fce7bc5 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:59 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-301a17e4-5fee-44c1-8227-83408fce7bc5 1073741824 Sep 28 16:19:59 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:59 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-301a17e4-5fee-44c1-8227-83408fce7bc5 1073741824" returned: 0 in 0.465s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-301a17e4-5fee-44c1-8227-83408fce7bc5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:59 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-301a17e4-5fee-44c1-8227-83408fce7bc5 Sep 28 16:19:59 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:59 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-301a17e4-5fee-44c1-8227-83408fce7bc5" returned: 0 in 0.294s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d033bb3-8bbd-4291-b3f9-41854dce9340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-301a17e4-5fee-44c1-8227-83408fce7bc5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6fd20b-173c-4c25-b665-50b111cbc86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:59 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Volume volume-301a17e4-5fee-44c1-8227-83408fce7bc5 (301a17e4-5fee-44c1-8227-83408fce7bc5): created successfully Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6fd20b-173c-4c25-b665-50b111cbc86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Flow 'volume_create_manager' (99633baf-3c61-484a-9376-d541d23fff1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:59 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-eedb7cd6-c929-4407-8c69-696206476215 tempest-ProjectReaderTests-2116297773 None] Created volume successfully. Sep 28 16:20:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] Acquiring lock "cinder-301a17e4-5fee-44c1-8227-83408fce7bc5-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] Lock "cinder-301a17e4-5fee-44c1-8227-83408fce7bc5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] Acquiring lock "cinder-quobyte-301a17e4-5fee-44c1-8227-83408fce7bc5" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] Lock "cinder-quobyte-301a17e4-5fee-44c1-8227-83408fce7bc5" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:01 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[519dafc5-43f8-49b4-8006-6fdb1f496800]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-301a17e4-5fee-44c1-8227-83408fce7bc5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:01 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-301a17e4-5fee-44c1-8227-83408fce7bc5 Sep 28 16:20:01 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:01 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-301a17e4-5fee-44c1-8227-83408fce7bc5" returned: 0 in 0.437s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-301a17e4-5fee-44c1-8227-83408fce7bc5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:01 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-301a17e4-5fee-44c1-8227-83408fce7bc5 Sep 28 16:20:01 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:01 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-301a17e4-5fee-44c1-8227-83408fce7bc5" returned: 0 in 0.286s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] Lock "cinder-quobyte-301a17e4-5fee-44c1-8227-83408fce7bc5" released by "delete_volume" :: held 0.776s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] Created reservations ['90273296-1fd8-4700-bcfd-6d7fa2ced9eb', '877a2300-6dcf-4322-919b-b5bef21698cb', '03c6c482-38c4-4e45-9764-ff0d4f9b7712', 'dd7e6b93-cab2-4b21-892f-36beebf98d4f'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:02 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:20:02 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:02 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.290s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:02 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] Deleted volume successfully. Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-195be8c3-dc35-462c-a69e-0571c9a3de21 tempest-ProjectReaderTests-2116297773 None] Lock "cinder-301a17e4-5fee-44c1-8227-83408fce7bc5-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Flow 'volume_create_manager' (b2761dc7-4a08-43fe-b536-2b86d758d4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f02d3e5-1a97-4c2c-a7c6-aac72115ac50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f02d3e5-1a97-4c2c-a7c6-aac72115ac50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1379730059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d07695-e7a7-4d77-9cfc-0a9ec2370585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6131ca6a227c47f79026e0ad84e454bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:03Z,use_quota=True,user_id='1a89753a1c6d436199bc085f525d8fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b161bd-24f7-41ff-85c7-dff061fcf167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b161bd-24f7-41ff-85c7-dff061fcf167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b123b7a-d032-4f99-bff6-f2e43371f022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b123b7a-d032-4f99-bff6-f2e43371f022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10d07695-e7a7-4d77-9cfc-0a9ec2370585', 'volume_name': 'volume-10d07695-e7a7-4d77-9cfc-0a9ec2370585', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32cf514-a264-41ac-bb67-be993efe0bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32cf514-a264-41ac-bb67-be993efe0bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01694e92-3b06-4c9c-8d64-c2120ec73b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:02 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Volume 10d07695-e7a7-4d77-9cfc-0a9ec2370585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10d07695-e7a7-4d77-9cfc-0a9ec2370585', 'volume_size': 1} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1379730059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d07695-e7a7-4d77-9cfc-0a9ec2370585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6131ca6a227c47f79026e0ad84e454bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:03Z,use_quota=True,user_id='1a89753a1c6d436199bc085f525d8fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Creating volume 10d07695-e7a7-4d77-9cfc-0a9ec2370585 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:20:02 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:20:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-10d07695-e7a7-4d77-9cfc-0a9ec2370585 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:02 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-10d07695-e7a7-4d77-9cfc-0a9ec2370585 1073741824 Sep 28 16:20:02 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:03 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-10d07695-e7a7-4d77-9cfc-0a9ec2370585 1073741824" returned: 0 in 0.484s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-10d07695-e7a7-4d77-9cfc-0a9ec2370585 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:03 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-10d07695-e7a7-4d77-9cfc-0a9ec2370585 Sep 28 16:20:03 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:03 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-10d07695-e7a7-4d77-9cfc-0a9ec2370585" returned: 0 in 0.278s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:20:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01694e92-3b06-4c9c-8d64-c2120ec73b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10d07695-e7a7-4d77-9cfc-0a9ec2370585', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5447d88-b9f0-41c4-ade7-48ac45eab86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:03 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Volume volume-10d07695-e7a7-4d77-9cfc-0a9ec2370585 (10d07695-e7a7-4d77-9cfc-0a9ec2370585): created successfully Sep 28 16:20:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5447d88-b9f0-41c4-ade7-48ac45eab86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Flow 'volume_create_manager' (b2761dc7-4a08-43fe-b536-2b86d758d4ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9584a64c-7a3e-434f-8526-01a566938a5e tempest-ProjectReaderTests-2116297773 None] Created volume successfully. Sep 28 16:20:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] Acquiring lock "cinder-10d07695-e7a7-4d77-9cfc-0a9ec2370585-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] Lock "cinder-10d07695-e7a7-4d77-9cfc-0a9ec2370585-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] Acquiring lock "cinder-quobyte-10d07695-e7a7-4d77-9cfc-0a9ec2370585" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] Lock "cinder-quobyte-10d07695-e7a7-4d77-9cfc-0a9ec2370585" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:05 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8968da67-e88a-490b-ac91-1e513903c8fb]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-10d07695-e7a7-4d77-9cfc-0a9ec2370585 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:05 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-10d07695-e7a7-4d77-9cfc-0a9ec2370585 Sep 28 16:20:05 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:05 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-10d07695-e7a7-4d77-9cfc-0a9ec2370585" returned: 0 in 0.368s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-10d07695-e7a7-4d77-9cfc-0a9ec2370585 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:05 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-10d07695-e7a7-4d77-9cfc-0a9ec2370585 Sep 28 16:20:05 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:05 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-10d07695-e7a7-4d77-9cfc-0a9ec2370585" returned: 0 in 0.260s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] Lock "cinder-quobyte-10d07695-e7a7-4d77-9cfc-0a9ec2370585" released by "delete_volume" :: held 0.669s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:05 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] Created reservations ['51b21cf4-1fdf-4214-9a8f-f66a8e22bee3', '76535c85-164f-4075-9153-df139243166a', '94efb142-487b-4c95-89dc-4651a8d529a4', '593d08b5-8eee-404f-8ac7-541046c31f87'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:05 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:20:05 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:06 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.282s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:06 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] Deleted volume successfully. Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3a5cc392-e326-448d-a130-b0e87256da04 tempest-ProjectReaderTests-2116297773 None] Lock "cinder-10d07695-e7a7-4d77-9cfc-0a9ec2370585-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Flow 'volume_create_manager' (ebd19a2c-452e-4e01-a3cc-0760808eb91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1933836-7fd8-4683-a4a0-d9ff5f93546e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1933836-7fd8-4683-a4a0-d9ff5f93546e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-137763885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb8c1cd-0838-4023-9386-0698d5b6796c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6131ca6a227c47f79026e0ad84e454bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:07Z,use_quota=True,user_id='1a89753a1c6d436199bc085f525d8fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e28f8bd-b01a-43bc-9bef-74c088d6f194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e28f8bd-b01a-43bc-9bef-74c088d6f194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55d8ac9-6da2-48c5-a006-f834b85383f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55d8ac9-6da2-48c5-a006-f834b85383f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bb8c1cd-0838-4023-9386-0698d5b6796c', 'volume_name': 'volume-3bb8c1cd-0838-4023-9386-0698d5b6796c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbbef934-c1f7-49a2-beec-8af631ab3828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbbef934-c1f7-49a2-beec-8af631ab3828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2531ca8-c027-4478-8836-0f0003962b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:06 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Volume 3bb8c1cd-0838-4023-9386-0698d5b6796c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bb8c1cd-0838-4023-9386-0698d5b6796c', 'volume_size': 1} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-137763885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb8c1cd-0838-4023-9386-0698d5b6796c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6131ca6a227c47f79026e0ad84e454bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:07Z,use_quota=True,user_id='1a89753a1c6d436199bc085f525d8fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Creating volume 3bb8c1cd-0838-4023-9386-0698d5b6796c {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:20:06 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:20:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3bb8c1cd-0838-4023-9386-0698d5b6796c 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:06 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3bb8c1cd-0838-4023-9386-0698d5b6796c 1073741824 Sep 28 16:20:06 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:07 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3bb8c1cd-0838-4023-9386-0698d5b6796c 1073741824" returned: 0 in 0.474s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3bb8c1cd-0838-4023-9386-0698d5b6796c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:07 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3bb8c1cd-0838-4023-9386-0698d5b6796c Sep 28 16:20:07 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:07 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3bb8c1cd-0838-4023-9386-0698d5b6796c" returned: 0 in 0.330s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:20:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2531ca8-c027-4478-8836-0f0003962b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb8c1cd-0838-4023-9386-0698d5b6796c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5479b2a-16a0-4fd3-a3e4-c1e7a6f913d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:07 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Volume volume-3bb8c1cd-0838-4023-9386-0698d5b6796c (3bb8c1cd-0838-4023-9386-0698d5b6796c): created successfully Sep 28 16:20:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5479b2a-16a0-4fd3-a3e4-c1e7a6f913d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Flow 'volume_create_manager' (ebd19a2c-452e-4e01-a3cc-0760808eb91f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a3c2838a-43b4-4978-a842-0e3cfd29f7b0 tempest-ProjectReaderTests-2116297773 None] Created volume successfully. Sep 28 16:20:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] Acquiring lock "cinder-3bb8c1cd-0838-4023-9386-0698d5b6796c-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] Lock "cinder-3bb8c1cd-0838-4023-9386-0698d5b6796c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] Acquiring lock "cinder-quobyte-3bb8c1cd-0838-4023-9386-0698d5b6796c" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] Lock "cinder-quobyte-3bb8c1cd-0838-4023-9386-0698d5b6796c" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:08 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b002c308-b850-4bb9-96b2-344516a3f05a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3bb8c1cd-0838-4023-9386-0698d5b6796c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:09 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3bb8c1cd-0838-4023-9386-0698d5b6796c Sep 28 16:20:09 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:09 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3bb8c1cd-0838-4023-9386-0698d5b6796c" returned: 0 in 0.400s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3bb8c1cd-0838-4023-9386-0698d5b6796c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:09 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3bb8c1cd-0838-4023-9386-0698d5b6796c Sep 28 16:20:09 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:09 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3bb8c1cd-0838-4023-9386-0698d5b6796c" returned: 0 in 0.263s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] Lock "cinder-quobyte-3bb8c1cd-0838-4023-9386-0698d5b6796c" released by "delete_volume" :: held 0.709s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:09 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] Created reservations ['adb90958-1d65-44cf-aad5-169b328ca21c', '084957e2-f779-4cff-b668-d593297f3c06', '9f2f14d4-8bd9-4838-9cee-1923990bff4c', 'c177ee2f-2b76-476c-b998-83bc45b6c5c6'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:09 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:20:09 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:10 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.285s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:10 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] Deleted volume successfully. Sep 28 16:20:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eb1687f2-ff34-4723-98d6-48362ddfc623 tempest-ProjectReaderTests-2116297773 None] Lock "cinder-3bb8c1cd-0838-4023-9386-0698d5b6796c-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:18 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-789022c6-afd8-4485-b2d8-efb0792e7742 req-aab33f5f-5e37-4a6a-abef-aa3cd56bc3f5 tempest-TestShelveInstance-1353089502 None] Terminate volume connection completed successfully. Sep 28 16:20:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-789022c6-afd8-4485-b2d8-efb0792e7742 req-aab33f5f-5e37-4a6a-abef-aa3cd56bc3f5 tempest-TestShelveInstance-1353089502 None] Deleting attachment e05fafff-5b96-482d-a633-5ce8e46c107e. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:20:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-20dd30af-0bb7-414c-97aa-bc9abd0be94f req-d978acbb-e643-45e9-8d18-c44baa0757b5 tempest-TestShelveInstance-1353089502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-20dd30af-0bb7-414c-97aa-bc9abd0be94f req-d978acbb-e643-45e9-8d18-c44baa0757b5 tempest-TestShelveInstance-1353089502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-20dd30af-0bb7-414c-97aa-bc9abd0be94f req-d978acbb-e643-45e9-8d18-c44baa0757b5 tempest-TestShelveInstance-1353089502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-20dd30af-0bb7-414c-97aa-bc9abd0be94f req-d978acbb-e643-45e9-8d18-c44baa0757b5 tempest-TestShelveInstance-1353089502 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f', 'name': 'volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8390023a-bc4f-4398-85cb-89243d5f8b72', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:20:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-20dd30af-0bb7-414c-97aa-bc9abd0be94f req-d978acbb-e643-45e9-8d18-c44baa0757b5 tempest-TestShelveInstance-1353089502 None] attachment_update completed successfully. Sep 28 16:20:31 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=39,cinder:UPDATE=48,cinder:INSERT=10,cinder:DELETE=5 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:20:31 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=44,cinder:DELETE=3,cinder:SELECT=33,cinder:INSERT=10 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:20:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:20:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:35 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:20:35 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:35 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.296s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:20:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:20:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:21:05 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-7449c31a-2c53-447b-a55e-9dabed53183e req-4354b841-5828-40f0-bdb0-7d0eef6e2db2 tempest-TestShelveInstance-1353089502 None] Terminate volume connection completed successfully. Sep 28 16:21:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-7449c31a-2c53-447b-a55e-9dabed53183e req-4354b841-5828-40f0-bdb0-7d0eef6e2db2 tempest-TestShelveInstance-1353089502 None] Deleting attachment 8390023a-bc4f-4398-85cb-89243d5f8b72. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:21:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] Acquiring lock "cinder-e89f556e-8fc0-44a8-8fcc-3f52b91433e2-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] Lock "cinder-e89f556e-8fc0-44a8-8fcc-3f52b91433e2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] Acquiring lock "cinder-quobyte-e89f556e-8fc0-44a8-8fcc-3f52b91433e2" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] Lock "cinder-quobyte-e89f556e-8fc0-44a8-8fcc-3f52b91433e2" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:05 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fd9781-c6d1-445f-b7cc-6c76f36ad59d]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:06 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2 Sep 28 16:21:06 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:06 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2" returned: 0 in 0.455s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:06 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2 Sep 28 16:21:06 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:06 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e89f556e-8fc0-44a8-8fcc-3f52b91433e2" returned: 0 in 0.251s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] Lock "cinder-quobyte-e89f556e-8fc0-44a8-8fcc-3f52b91433e2" released by "delete_volume" :: held 0.756s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:06 devstack cinder-volume[87087]: DEBUG cinder.quota [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] Created reservations ['bfdc27f2-145b-439d-a16b-6ef98bdb084f', '441c523b-c440-4276-ab39-d349d8037aea', '3bd49413-13e5-4f21-855e-fc1b23a54512', '5ab86c2c-cf13-49dd-9b05-827c09a73b25'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:06 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:21:06 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:07 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.285s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:07 devstack cinder-volume[87087]: DEBUG cinder.manager [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] Deleted volume successfully. Sep 28 16:21:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-7449c31a-2c53-447b-a55e-9dabed53183e req-ada70985-4b8a-4b78-8dfc-a182d5eb0ae3 tempest-TestShelveInstance-1353089502 None] Lock "cinder-e89f556e-8fc0-44a8-8fcc-3f52b91433e2-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:16 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:21:17 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:21:20 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Flow 'volume_create_manager' (c70bcfb9-36d1-4e9d-9351-0629e0b66e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01efdb6-0549-4ee0-b53c-aaa18a07293c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01efdb6-0549-4ee0-b53c-aaa18a07293c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1258504771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a840ba2d8891403b9b4de32bc94ca152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:21Z,use_quota=True,user_id='37140709f53349fea1f194198c9d7352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a4d29e-cbc1-4879-83de-b9b0f683b92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a4d29e-cbc1-4879-83de-b9b0f683b92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40948fc-9104-4f7b-b94d-966c6757927c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40948fc-9104-4f7b-b94d-966c6757927c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f', 'volume_name': 'volume-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e49f92-1e6e-451d-85c4-97de6523bdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e49f92-1e6e-451d-85c4-97de6523bdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e853c1f2-e371-46c7-9329-da5ece63460c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:20 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Volume ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f', 'volume_size': 1} Sep 28 16:21:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1258504771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a840ba2d8891403b9b4de32bc94ca152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:21Z,use_quota=True,user_id='37140709f53349fea1f194198c9d7352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Creating volume ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:21 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:21 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f 1073741824 Sep 28 16:21:21 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Flow 'volume_create_manager' (ffc33650-32a8-46b0-b318-cf06262cf41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201cc96f-e4d7-458c-b8fd-f11cd214e0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201cc96f-e4d7-458c-b8fd-f11cd214e0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1050541860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ad796b-0124-4e72-93a9-34a2f3b23131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a840ba2d8891403b9b4de32bc94ca152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:21Z,use_quota=True,user_id='37140709f53349fea1f194198c9d7352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9d5cfe-6bee-49d9-848e-9fb330411b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9d5cfe-6bee-49d9-848e-9fb330411b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d305731c-1978-441d-b56d-f33281eb7700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d305731c-1978-441d-b56d-f33281eb7700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ad796b-0124-4e72-93a9-34a2f3b23131', 'volume_name': 'volume-c6ad796b-0124-4e72-93a9-34a2f3b23131', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c49354-038b-4eb8-8932-c9f9106b4f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c49354-038b-4eb8-8932-c9f9106b4f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc632ec-84fe-4d3d-8ff5-e1d54df304ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:21 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Volume c6ad796b-0124-4e72-93a9-34a2f3b23131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ad796b-0124-4e72-93a9-34a2f3b23131', 'volume_size': 1} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:21 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f 1073741824" returned: 0 in 0.562s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:21 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f Sep 28 16:21:21 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Flow 'volume_create_manager' (83276ec9-2794-4a91-9efd-aecdfa4fb8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f09da0-c077-43e7-a6ad-5a896b02242f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f09da0-c077-43e7-a6ad-5a896b02242f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1415166971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbb54a42-47a2-4b39-917e-e8550e458757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a840ba2d8891403b9b4de32bc94ca152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:22Z,use_quota=True,user_id='37140709f53349fea1f194198c9d7352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e57ebaa-2671-437d-9a27-604f2f7b5e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e57ebaa-2671-437d-9a27-604f2f7b5e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab87e23-e565-4851-9b22-6d82d91df030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab87e23-e565-4851-9b22-6d82d91df030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbb54a42-47a2-4b39-917e-e8550e458757', 'volume_name': 'volume-dbb54a42-47a2-4b39-917e-e8550e458757', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87707f8-46bd-46f0-974f-4b0c591dbef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87707f8-46bd-46f0-974f-4b0c591dbef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc3e6ce-7dc3-4c30-a651-d75f619b4262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:21 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Volume dbb54a42-47a2-4b39-917e-e8550e458757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbb54a42-47a2-4b39-917e-e8550e458757', 'volume_size': 1} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:21 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f" returned: 0 in 0.309s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.496s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1050541860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ad796b-0124-4e72-93a9-34a2f3b23131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a840ba2d8891403b9b4de32bc94ca152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:21Z,use_quota=True,user_id='37140709f53349fea1f194198c9d7352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Creating volume c6ad796b-0124-4e72-93a9-34a2f3b23131 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:21 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c6ad796b-0124-4e72-93a9-34a2f3b23131 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e853c1f2-e371-46c7-9329-da5ece63460c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2197022-f051-407e-bc9c-74fd8e14c1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:21 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c6ad796b-0124-4e72-93a9-34a2f3b23131 1073741824 Sep 28 16:21:21 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:22 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Volume volume-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f (ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f): created successfully Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2197022-f051-407e-bc9c-74fd8e14c1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Flow 'volume_create_manager' (c70bcfb9-36d1-4e9d-9351-0629e0b66e0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:22 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b393f92b-c270-465a-aabb-f167489e7682 tempest-CreateVolumesFromImageTest-333018222 None] Created volume successfully. Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Flow 'volume_create_manager' (5fa4b1fc-142a-4e04-95a5-c544a36465a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd57cfe0-38e8-41d2-a3cd-791e505872b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd57cfe0-38e8-41d2-a3cd-791e505872b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1938665245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e500fe-f6eb-416f-8579-2685ae46e729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a840ba2d8891403b9b4de32bc94ca152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:22Z,use_quota=True,user_id='37140709f53349fea1f194198c9d7352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b918280e-c6c3-47fe-82d1-0b174da80f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b918280e-c6c3-47fe-82d1-0b174da80f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f971732-12cd-4233-a262-571ac49a35ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f971732-12cd-4233-a262-571ac49a35ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e500fe-f6eb-416f-8579-2685ae46e729', 'volume_name': 'volume-a1e500fe-f6eb-416f-8579-2685ae46e729', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370ddd61-d193-4d3e-8419-23c90d26a6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370ddd61-d193-4d3e-8419-23c90d26a6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d44fca-6aee-4aaa-86d9-bcc9b2213936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:22 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Volume a1e500fe-f6eb-416f-8579-2685ae46e729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e500fe-f6eb-416f-8579-2685ae46e729', 'volume_size': 1} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:22 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c6ad796b-0124-4e72-93a9-34a2f3b23131 1073741824" returned: 0 in 0.638s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c6ad796b-0124-4e72-93a9-34a2f3b23131 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:22 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c6ad796b-0124-4e72-93a9-34a2f3b23131 Sep 28 16:21:22 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Flow 'volume_create_manager' (6e890c00-b448-4f1d-8436-fb2091cb5d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96219d8b-b6ef-4102-af83-bbcd0bf766e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96219d8b-b6ef-4102-af83-bbcd0bf766e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-239889280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872573f7-69e2-430e-a93c-2eeacbf89a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a840ba2d8891403b9b4de32bc94ca152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:23Z,use_quota=True,user_id='37140709f53349fea1f194198c9d7352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fd86a3-aeee-44eb-9931-7384810a3b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fd86a3-aeee-44eb-9931-7384810a3b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f3879e-fe5c-4484-b075-dc712c9a6185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f3879e-fe5c-4484-b075-dc712c9a6185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '872573f7-69e2-430e-a93c-2eeacbf89a3c', 'volume_name': 'volume-872573f7-69e2-430e-a93c-2eeacbf89a3c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f152f1d-c32d-4cdf-8628-0d5eea8f1e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f152f1d-c32d-4cdf-8628-0d5eea8f1e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a31817-d90f-4d91-9cc1-3f45f3e49f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:22 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Volume 872573f7-69e2-430e-a93c-2eeacbf89a3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-872573f7-69e2-430e-a93c-2eeacbf89a3c', 'volume_size': 1} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:22 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c6ad796b-0124-4e72-93a9-34a2f3b23131" returned: 0 in 0.279s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.033s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1415166971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbb54a42-47a2-4b39-917e-e8550e458757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a840ba2d8891403b9b4de32bc94ca152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:22Z,use_quota=True,user_id='37140709f53349fea1f194198c9d7352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Creating volume dbb54a42-47a2-4b39-917e-e8550e458757 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:22 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-dbb54a42-47a2-4b39-917e-e8550e458757 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc632ec-84fe-4d3d-8ff5-e1d54df304ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ad796b-0124-4e72-93a9-34a2f3b23131', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:22 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-dbb54a42-47a2-4b39-917e-e8550e458757 1073741824 Sep 28 16:21:22 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9a89bf-3abb-4bf2-87f4-de608d3e9052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:22 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Volume volume-c6ad796b-0124-4e72-93a9-34a2f3b23131 (c6ad796b-0124-4e72-93a9-34a2f3b23131): created successfully Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9a89bf-3abb-4bf2-87f4-de608d3e9052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Flow 'volume_create_manager' (ffc33650-32a8-46b0-b318-cf06262cf41a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:23 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-29ddda12-3d21-4a3d-abfd-77622b17383e tempest-CreateVolumesFromImageTest-333018222 None] Created volume successfully. Sep 28 16:21:23 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-dbb54a42-47a2-4b39-917e-e8550e458757 1073741824" returned: 0 in 0.534s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-dbb54a42-47a2-4b39-917e-e8550e458757 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:23 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-dbb54a42-47a2-4b39-917e-e8550e458757 Sep 28 16:21:23 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:23 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-dbb54a42-47a2-4b39-917e-e8550e458757" returned: 0 in 0.278s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.419s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1938665245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e500fe-f6eb-416f-8579-2685ae46e729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a840ba2d8891403b9b4de32bc94ca152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:22Z,use_quota=True,user_id='37140709f53349fea1f194198c9d7352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Creating volume a1e500fe-f6eb-416f-8579-2685ae46e729 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:23 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:21:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1e500fe-f6eb-416f-8579-2685ae46e729 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc3e6ce-7dc3-4c30-a651-d75f619b4262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbb54a42-47a2-4b39-917e-e8550e458757', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:23 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1e500fe-f6eb-416f-8579-2685ae46e729 1073741824 Sep 28 16:21:23 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4592fb-c53e-40ed-b734-71615ce4e2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:23 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Volume volume-dbb54a42-47a2-4b39-917e-e8550e458757 (dbb54a42-47a2-4b39-917e-e8550e458757): created successfully Sep 28 16:21:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4592fb-c53e-40ed-b734-71615ce4e2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Flow 'volume_create_manager' (83276ec9-2794-4a91-9efd-aecdfa4fb8bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:23 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-75c470cc-9e11-4ac6-a1ad-267b98198e12 tempest-CreateVolumesFromImageTest-333018222 None] Created volume successfully. Sep 28 16:21:24 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1e500fe-f6eb-416f-8579-2685ae46e729 1073741824" returned: 0 in 0.449s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1e500fe-f6eb-416f-8579-2685ae46e729 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:24 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1e500fe-f6eb-416f-8579-2685ae46e729 Sep 28 16:21:24 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:24 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1e500fe-f6eb-416f-8579-2685ae46e729" returned: 0 in 0.275s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.791s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-239889280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872573f7-69e2-430e-a93c-2eeacbf89a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a840ba2d8891403b9b4de32bc94ca152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:23Z,use_quota=True,user_id='37140709f53349fea1f194198c9d7352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Creating volume 872573f7-69e2-430e-a93c-2eeacbf89a3c {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:24 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:21:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-872573f7-69e2-430e-a93c-2eeacbf89a3c 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:24 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-872573f7-69e2-430e-a93c-2eeacbf89a3c 1073741824 Sep 28 16:21:24 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d44fca-6aee-4aaa-86d9-bcc9b2213936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e500fe-f6eb-416f-8579-2685ae46e729', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf2ab52-8e69-4d42-a65d-f07b25b2182c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:24 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Volume volume-a1e500fe-f6eb-416f-8579-2685ae46e729 (a1e500fe-f6eb-416f-8579-2685ae46e729): created successfully Sep 28 16:21:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf2ab52-8e69-4d42-a65d-f07b25b2182c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Flow 'volume_create_manager' (5fa4b1fc-142a-4e04-95a5-c544a36465a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-53165112-2ee4-4456-9520-ded9cd6cc984 tempest-CreateVolumesFromImageTest-333018222 None] Created volume successfully. Sep 28 16:21:25 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-872573f7-69e2-430e-a93c-2eeacbf89a3c 1073741824" returned: 0 in 0.513s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-872573f7-69e2-430e-a93c-2eeacbf89a3c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:25 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-872573f7-69e2-430e-a93c-2eeacbf89a3c Sep 28 16:21:25 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:25 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-872573f7-69e2-430e-a93c-2eeacbf89a3c" returned: 0 in 0.278s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a31817-d90f-4d91-9cc1-3f45f3e49f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-872573f7-69e2-430e-a93c-2eeacbf89a3c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f92ced-1dd0-4084-8111-0ad5d36c3667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:25 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Volume volume-872573f7-69e2-430e-a93c-2eeacbf89a3c (872573f7-69e2-430e-a93c-2eeacbf89a3c): created successfully Sep 28 16:21:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f92ced-1dd0-4084-8111-0ad5d36c3667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Flow 'volume_create_manager' (6e890c00-b448-4f1d-8436-fb2091cb5d4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:25 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-eb57fb50-1df4-4426-99b0-69a1cc844a4a tempest-CreateVolumesFromImageTest-333018222 None] Created volume successfully. Sep 28 16:21:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "cinder-872573f7-69e2-430e-a93c-2eeacbf89a3c-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-872573f7-69e2-430e-a93c-2eeacbf89a3c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "cinder-quobyte-872573f7-69e2-430e-a93c-2eeacbf89a3c" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-quobyte-872573f7-69e2-430e-a93c-2eeacbf89a3c" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:26 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c428868b-8dad-4fec-89fb-d23d4ad959ba]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-872573f7-69e2-430e-a93c-2eeacbf89a3c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:26 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-872573f7-69e2-430e-a93c-2eeacbf89a3c Sep 28 16:21:26 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:26 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-872573f7-69e2-430e-a93c-2eeacbf89a3c" returned: 0 in 0.403s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-872573f7-69e2-430e-a93c-2eeacbf89a3c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:26 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-872573f7-69e2-430e-a93c-2eeacbf89a3c Sep 28 16:21:26 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:26 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-872573f7-69e2-430e-a93c-2eeacbf89a3c" returned: 0 in 0.260s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-quobyte-872573f7-69e2-430e-a93c-2eeacbf89a3c" released by "delete_volume" :: held 0.708s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:26 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] Created reservations ['7cc809a7-84c1-42a4-ba24-89ba3d121a75', '756a6971-302d-4e7c-93eb-1c8983d11eef', 'ab83adb9-679e-4c95-9515-d0380320577c', 'a10807ea-4ae0-40df-9e91-ca9aeb3797ed'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:27 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:21:27 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "cinder-a1e500fe-f6eb-416f-8579-2685ae46e729-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:27 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-a1e500fe-f6eb-416f-8579-2685ae46e729-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.304s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:27 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] Deleted volume successfully. Sep 28 16:21:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-df978eab-590a-4ffe-a7e0-7e87dbb1629a tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-872573f7-69e2-430e-a93c-2eeacbf89a3c-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "cinder-quobyte-a1e500fe-f6eb-416f-8579-2685ae46e729" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-quobyte-a1e500fe-f6eb-416f-8579-2685ae46e729" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:27 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f50217-fb73-48d3-8d98-9fe8a28a5eed]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1e500fe-f6eb-416f-8579-2685ae46e729 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:27 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1e500fe-f6eb-416f-8579-2685ae46e729 Sep 28 16:21:27 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:27 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1e500fe-f6eb-416f-8579-2685ae46e729" returned: 0 in 0.406s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1e500fe-f6eb-416f-8579-2685ae46e729 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:27 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1e500fe-f6eb-416f-8579-2685ae46e729 Sep 28 16:21:27 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:28 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1e500fe-f6eb-416f-8579-2685ae46e729" returned: 0 in 0.287s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-quobyte-a1e500fe-f6eb-416f-8579-2685ae46e729" released by "delete_volume" :: held 0.734s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:28 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] Created reservations ['87bb4bcf-f927-409f-b088-fdd2a19aac6b', 'cd779aca-c075-42f0-82d2-7dacd1065e42', '342b00e2-9108-4140-97c0-aaee9f5987f4', '771ebd86-2b06-4a15-95be-97a2bececf01'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:28 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:21:28 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "cinder-dbb54a42-47a2-4b39-917e-e8550e458757-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-dbb54a42-47a2-4b39-917e-e8550e458757-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:28 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.286s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:28 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:28 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] Deleted volume successfully. Sep 28 16:21:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "cinder-quobyte-dbb54a42-47a2-4b39-917e-e8550e458757" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-quobyte-dbb54a42-47a2-4b39-917e-e8550e458757" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3ffe70cb-a1f6-4bda-a38f-bc551cd3364e tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-a1e500fe-f6eb-416f-8579-2685ae46e729-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:28 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc9af46-176e-4fc4-b587-58eb6713ac73]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-dbb54a42-47a2-4b39-917e-e8550e458757 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:28 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-dbb54a42-47a2-4b39-917e-e8550e458757 Sep 28 16:21:28 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:29 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-dbb54a42-47a2-4b39-917e-e8550e458757" returned: 0 in 0.386s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-dbb54a42-47a2-4b39-917e-e8550e458757 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:29 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-dbb54a42-47a2-4b39-917e-e8550e458757 Sep 28 16:21:29 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:29 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-dbb54a42-47a2-4b39-917e-e8550e458757" returned: 0 in 0.279s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-quobyte-dbb54a42-47a2-4b39-917e-e8550e458757" released by "delete_volume" :: held 0.715s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] Created reservations ['c2c76b2b-9b0e-46cd-824c-ccacf9a1e8c2', 'd01487bc-b4d6-4cc8-bccd-077ced113a65', 'e3bff86b-eb6f-4d10-af88-2bcffb18abb1', '90f7cb46-8195-4917-8f71-4b4d6771f601'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:29 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:21:29 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "cinder-c6ad796b-0124-4e72-93a9-34a2f3b23131-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-c6ad796b-0124-4e72-93a9-34a2f3b23131-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:29 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.339s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] Deleted volume successfully. Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "cinder-quobyte-c6ad796b-0124-4e72-93a9-34a2f3b23131" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6cf1e112-5bc5-4204-ba32-e3762724f7b3 tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-dbb54a42-47a2-4b39-917e-e8550e458757-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-quobyte-c6ad796b-0124-4e72-93a9-34a2f3b23131" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e705eaa4-6c09-4000-ab1f-5c0bd1c7793a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c6ad796b-0124-4e72-93a9-34a2f3b23131 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:30 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c6ad796b-0124-4e72-93a9-34a2f3b23131 Sep 28 16:21:30 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:30 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c6ad796b-0124-4e72-93a9-34a2f3b23131" returned: 0 in 0.433s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c6ad796b-0124-4e72-93a9-34a2f3b23131 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:30 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c6ad796b-0124-4e72-93a9-34a2f3b23131 Sep 28 16:21:30 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:30 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c6ad796b-0124-4e72-93a9-34a2f3b23131" returned: 0 in 0.251s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-quobyte-c6ad796b-0124-4e72-93a9-34a2f3b23131" released by "delete_volume" :: held 0.736s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:30 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] Created reservations ['6ccadea4-d7c3-4083-baf1-cc3cc5612531', '0ab5e0c4-a573-4b7b-998d-0f13fa692cae', 'baec2030-1ad1-451b-aaac-4f0e855bbda9', '9af0b3d4-f6bb-46ec-9ef8-f0664f4bb553'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:30 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:21:30 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "cinder-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:30 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.275s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:30 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:31 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] Deleted volume successfully. Sep 28 16:21:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "cinder-quobyte-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f7772ebb-5cde-4e74-93d3-98b14f2f3eb9 tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-c6ad796b-0124-4e72-93a9-34a2f3b23131-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-quobyte-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86bd3f3-9fd5-450a-bdef-f93a70d100b1]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:31 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f Sep 28 16:21:31 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:31 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f" returned: 0 in 0.396s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:31 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f Sep 28 16:21:31 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:31 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f" returned: 0 in 0.263s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-quobyte-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f" released by "delete_volume" :: held 0.709s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:31 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] Created reservations ['ccad5c11-2f7a-42f7-9517-c0f67e3303d5', '12c681fc-b774-46c4-a197-7db79730e5f9', '88750618-e5dc-4299-8538-9efbedf2f5f8', 'a50e1673-6320-412c-8215-f8697d39503d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:31 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:21:31 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:32 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.284s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:32 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:32 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] Deleted volume successfully. Sep 28 16:21:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-99c8f197-be25-4bb2-b5f6-32b3ad2ee308 tempest-CreateVolumesFromImageTest-333018222 None] Lock "cinder-ac3b758c-24f4-40ed-b9fc-d7ddbcc0e78f-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:35 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:21:35 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Flow 'volume_create_manager' (2ebb8855-7326-490d-8d09-123b4e030923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c5d272-e18f-4420-b877-9047fccedd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c5d272-e18f-4420-b877-9047fccedd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-716677720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5256b49e-f6b4-465c-aee1-4f0289635c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce1fc7b2624bd19b65c7b0ae55a6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:35Z,use_quota=True,user_id='3375bc9dfc6a4dafa854b53bb855aef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8800c453-32e5-4ff3-be59-beec54f9437b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8800c453-32e5-4ff3-be59-beec54f9437b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ba47a5-6e51-4a24-8ade-2be124080142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ba47a5-6e51-4a24-8ade-2be124080142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5256b49e-f6b4-465c-aee1-4f0289635c0f', 'volume_name': 'volume-5256b49e-f6b4-465c-aee1-4f0289635c0f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119110ad-a3c9-4644-b554-a9c8b4429cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119110ad-a3c9-4644-b554-a9c8b4429cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090541e2-bc9e-49a2-ab71-43e9b41cbb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:35 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Volume 5256b49e-f6b4-465c-aee1-4f0289635c0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5256b49e-f6b4-465c-aee1-4f0289635c0f', 'volume_size': 1} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-716677720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5256b49e-f6b4-465c-aee1-4f0289635c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce1fc7b2624bd19b65c7b0ae55a6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:35Z,use_quota=True,user_id='3375bc9dfc6a4dafa854b53bb855aef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Creating volume 5256b49e-f6b4-465c-aee1-4f0289635c0f {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:35 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5256b49e-f6b4-465c-aee1-4f0289635c0f 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:35 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5256b49e-f6b4-465c-aee1-4f0289635c0f 1073741824 Sep 28 16:21:35 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:35 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.309s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:21:35 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5256b49e-f6b4-465c-aee1-4f0289635c0f 1073741824" returned: 0 in 0.461s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5256b49e-f6b4-465c-aee1-4f0289635c0f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:35 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5256b49e-f6b4-465c-aee1-4f0289635c0f Sep 28 16:21:35 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:36 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5256b49e-f6b4-465c-aee1-4f0289635c0f" returned: 0 in 0.259s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090541e2-bc9e-49a2-ab71-43e9b41cbb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5256b49e-f6b4-465c-aee1-4f0289635c0f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ffc755-9bdf-4cc2-97c4-9f1b2f22cdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:36 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Volume volume-5256b49e-f6b4-465c-aee1-4f0289635c0f (5256b49e-f6b4-465c-aee1-4f0289635c0f): created successfully Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ffc755-9bdf-4cc2-97c4-9f1b2f22cdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Flow 'volume_create_manager' (2ebb8855-7326-490d-8d09-123b4e030923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-dca16a4d-3fea-4c2b-b7fe-ebd8541a8304 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Created volume successfully. Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Flow 'volume_create_manager' (3f7fe902-19b5-47ef-bee5-d02d7df024a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f8a811d-6b85-4aa0-8256-42dbecefdad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f8a811d-6b85-4aa0-8256-42dbecefdad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1589459865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba73f30-6e81-45e8-a955-3acd8b5252ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce1fc7b2624bd19b65c7b0ae55a6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:37Z,use_quota=True,user_id='3375bc9dfc6a4dafa854b53bb855aef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c2cbb8-c6c4-4627-b08b-fc0d55bf4705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c2cbb8-c6c4-4627-b08b-fc0d55bf4705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb0d585-97f6-41c8-b351-7e68270b4404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb0d585-97f6-41c8-b351-7e68270b4404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ba73f30-6e81-45e8-a955-3acd8b5252ec', 'volume_name': 'volume-2ba73f30-6e81-45e8-a955-3acd8b5252ec', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e784f8-a52a-4dc4-949a-254005a32557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e784f8-a52a-4dc4-949a-254005a32557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59defd2f-10b2-47da-b3d2-e842bb26ee8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:36 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Volume 2ba73f30-6e81-45e8-a955-3acd8b5252ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ba73f30-6e81-45e8-a955-3acd8b5252ec', 'volume_size': 1} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1589459865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba73f30-6e81-45e8-a955-3acd8b5252ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce1fc7b2624bd19b65c7b0ae55a6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:37Z,use_quota=True,user_id='3375bc9dfc6a4dafa854b53bb855aef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Creating volume 2ba73f30-6e81-45e8-a955-3acd8b5252ec {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:36 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:21:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2ba73f30-6e81-45e8-a955-3acd8b5252ec 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:36 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2ba73f30-6e81-45e8-a955-3acd8b5252ec 1073741824 Sep 28 16:21:36 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Flow 'volume_create_manager' (2d493e08-10ae-4a26-8268-574be8775779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9abba9b8-72ef-4690-bb9c-6d79df353d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9abba9b8-72ef-4690-bb9c-6d79df353d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-929935207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde83c00-a2b6-4659-ad0e-f9789179061b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce1fc7b2624bd19b65c7b0ae55a6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:37Z,use_quota=True,user_id='3375bc9dfc6a4dafa854b53bb855aef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed8ebb5c-8ea0-48dd-9190-cbf433ea0423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed8ebb5c-8ea0-48dd-9190-cbf433ea0423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983fc035-53d5-4cde-9449-a1994c46f078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983fc035-53d5-4cde-9449-a1994c46f078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cde83c00-a2b6-4659-ad0e-f9789179061b', 'volume_name': 'volume-cde83c00-a2b6-4659-ad0e-f9789179061b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf132bc-dbb2-416f-8941-d3b29fc104d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf132bc-dbb2-416f-8941-d3b29fc104d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca5970d1-8918-4bc4-abeb-32b2b98ddf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:37 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Volume cde83c00-a2b6-4659-ad0e-f9789179061b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cde83c00-a2b6-4659-ad0e-f9789179061b', 'volume_size': 1} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:37 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2ba73f30-6e81-45e8-a955-3acd8b5252ec 1073741824" returned: 0 in 0.642s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2ba73f30-6e81-45e8-a955-3acd8b5252ec {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:37 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2ba73f30-6e81-45e8-a955-3acd8b5252ec Sep 28 16:21:37 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Flow 'volume_create_manager' (dae93205-ef57-4b85-bee0-a057ffd22b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4524c59-45b4-48d6-8207-9522840f3545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4524c59-45b4-48d6-8207-9522840f3545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2064905743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310fd37a-7584-434b-86f0-d9d04f648f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce1fc7b2624bd19b65c7b0ae55a6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:38Z,use_quota=True,user_id='3375bc9dfc6a4dafa854b53bb855aef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a7cf20-c044-4761-bf0c-95f240d0f05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a7cf20-c044-4761-bf0c-95f240d0f05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0db0013-4bb1-4859-84fe-3c4907e82d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0db0013-4bb1-4859-84fe-3c4907e82d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '310fd37a-7584-434b-86f0-d9d04f648f2d', 'volume_name': 'volume-310fd37a-7584-434b-86f0-d9d04f648f2d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426be30f-7d35-489b-8d8d-d9f220d0f111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426be30f-7d35-489b-8d8d-d9f220d0f111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b582b9-e090-41b7-929f-759a578c1037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:37 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Volume 310fd37a-7584-434b-86f0-d9d04f648f2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-310fd37a-7584-434b-86f0-d9d04f648f2d', 'volume_size': 1} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:37 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2ba73f30-6e81-45e8-a955-3acd8b5252ec" returned: 0 in 0.307s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.460s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-929935207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde83c00-a2b6-4659-ad0e-f9789179061b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce1fc7b2624bd19b65c7b0ae55a6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:37Z,use_quota=True,user_id='3375bc9dfc6a4dafa854b53bb855aef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Creating volume cde83c00-a2b6-4659-ad0e-f9789179061b {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:37 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cde83c00-a2b6-4659-ad0e-f9789179061b 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59defd2f-10b2-47da-b3d2-e842bb26ee8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ba73f30-6e81-45e8-a955-3acd8b5252ec', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:37 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cde83c00-a2b6-4659-ad0e-f9789179061b 1073741824 Sep 28 16:21:37 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63f2b55-a838-4600-8a61-15391e4c6014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:37 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Volume volume-2ba73f30-6e81-45e8-a955-3acd8b5252ec (2ba73f30-6e81-45e8-a955-3acd8b5252ec): created successfully Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63f2b55-a838-4600-8a61-15391e4c6014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Flow 'volume_create_manager' (3f7fe902-19b5-47ef-bee5-d02d7df024a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d1f4946b-c0d7-4509-b106-3c9dd27dfa9b tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Created volume successfully. Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Flow 'volume_create_manager' (78eb4fbe-16ed-4948-8708-5e74f48915ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3f7fa5-f6f9-426b-8d78-50c8c548b703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3f7fa5-f6f9-426b-8d78-50c8c548b703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1887724886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73347f56-4e83-4f9a-9eb9-8df25bfb8d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce1fc7b2624bd19b65c7b0ae55a6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:38Z,use_quota=True,user_id='3375bc9dfc6a4dafa854b53bb855aef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb2d077-1105-4a81-9982-33f80f780bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb2d077-1105-4a81-9982-33f80f780bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191ea9d6-89d8-4d0a-8664-168f029667bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191ea9d6-89d8-4d0a-8664-168f029667bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73347f56-4e83-4f9a-9eb9-8df25bfb8d1f', 'volume_name': 'volume-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280f3313-87af-4572-ad3c-c86b065b2f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280f3313-87af-4572-ad3c-c86b065b2f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194f419a-c359-4437-91c9-a80e37cfb75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:38 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Volume 73347f56-4e83-4f9a-9eb9-8df25bfb8d1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f', 'volume_size': 1} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:38 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cde83c00-a2b6-4659-ad0e-f9789179061b 1073741824" returned: 0 in 0.554s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cde83c00-a2b6-4659-ad0e-f9789179061b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:38 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cde83c00-a2b6-4659-ad0e-f9789179061b Sep 28 16:21:38 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Flow 'volume_create_manager' (4d9e5c61-015c-4c44-8df7-325903251fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f507564-f36b-453d-833f-bde35f601ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f507564-f36b-453d-833f-bde35f601ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1910935411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ba7376-df59-4207-834f-32d662b54169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce1fc7b2624bd19b65c7b0ae55a6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:39Z,use_quota=True,user_id='3375bc9dfc6a4dafa854b53bb855aef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb615c7-6c65-4f68-859a-75dc1f1daf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb615c7-6c65-4f68-859a-75dc1f1daf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49b43ef-e2c3-432a-af11-5405ab0456f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49b43ef-e2c3-432a-af11-5405ab0456f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ba7376-df59-4207-834f-32d662b54169', 'volume_name': 'volume-b1ba7376-df59-4207-834f-32d662b54169', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c55cae-6625-411f-8703-54400346f8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c55cae-6625-411f-8703-54400346f8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:38 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316eef26-7a19-4241-8e1d-5938a4f5e531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:38 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Volume b1ba7376-df59-4207-834f-32d662b54169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ba7376-df59-4207-834f-32d662b54169', 'volume_size': 1} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cde83c00-a2b6-4659-ad0e-f9789179061b" returned: 0 in 0.292s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.926s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2064905743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310fd37a-7584-434b-86f0-d9d04f648f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce1fc7b2624bd19b65c7b0ae55a6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:38Z,use_quota=True,user_id='3375bc9dfc6a4dafa854b53bb855aef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Creating volume 310fd37a-7584-434b-86f0-d9d04f648f2d {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:38 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-310fd37a-7584-434b-86f0-d9d04f648f2d 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca5970d1-8918-4bc4-abeb-32b2b98ddf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cde83c00-a2b6-4659-ad0e-f9789179061b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:38 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-310fd37a-7584-434b-86f0-d9d04f648f2d 1073741824 Sep 28 16:21:38 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7255ceb1-ee8a-4ee5-8aac-8c89eeb97a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:38 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Volume volume-cde83c00-a2b6-4659-ad0e-f9789179061b (cde83c00-a2b6-4659-ad0e-f9789179061b): created successfully Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7255ceb1-ee8a-4ee5-8aac-8c89eeb97a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Flow 'volume_create_manager' (2d493e08-10ae-4a26-8268-574be8775779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:38 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d82c98f4-7c59-46ec-aa79-620f99e1ae87 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Created volume successfully. Sep 28 16:21:39 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-310fd37a-7584-434b-86f0-d9d04f648f2d 1073741824" returned: 0 in 0.453s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-310fd37a-7584-434b-86f0-d9d04f648f2d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:39 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-310fd37a-7584-434b-86f0-d9d04f648f2d Sep 28 16:21:39 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:39 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-310fd37a-7584-434b-86f0-d9d04f648f2d" returned: 0 in 0.249s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.228s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1887724886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73347f56-4e83-4f9a-9eb9-8df25bfb8d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce1fc7b2624bd19b65c7b0ae55a6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:38Z,use_quota=True,user_id='3375bc9dfc6a4dafa854b53bb855aef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Creating volume 73347f56-4e83-4f9a-9eb9-8df25bfb8d1f {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:39 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:39 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f 1073741824 Sep 28 16:21:39 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b582b9-e090-41b7-929f-759a578c1037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-310fd37a-7584-434b-86f0-d9d04f648f2d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ba4f98-d2c2-4a7b-b187-229f42d68678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:39 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Volume volume-310fd37a-7584-434b-86f0-d9d04f648f2d (310fd37a-7584-434b-86f0-d9d04f648f2d): created successfully Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ba4f98-d2c2-4a7b-b187-229f42d68678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Flow 'volume_create_manager' (dae93205-ef57-4b85-bee0-a057ffd22b53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-52452d34-d6a4-487e-9b35-5a0a4a397d31 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Created volume successfully. Sep 28 16:21:39 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f 1073741824" returned: 0 in 0.463s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:40 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f Sep 28 16:21:40 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:40 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f" returned: 0 in 0.253s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.525s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1910935411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ba7376-df59-4207-834f-32d662b54169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce1fc7b2624bd19b65c7b0ae55a6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:39Z,use_quota=True,user_id='3375bc9dfc6a4dafa854b53bb855aef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Creating volume b1ba7376-df59-4207-834f-32d662b54169 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:40 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b1ba7376-df59-4207-834f-32d662b54169 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194f419a-c359-4437-91c9-a80e37cfb75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:40 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b1ba7376-df59-4207-834f-32d662b54169 1073741824 Sep 28 16:21:40 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe4f5aa-eb89-4c02-b728-cb3cbf5e0713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:40 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Volume volume-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f (73347f56-4e83-4f9a-9eb9-8df25bfb8d1f): created successfully Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe4f5aa-eb89-4c02-b728-cb3cbf5e0713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Flow 'volume_create_manager' (78eb4fbe-16ed-4948-8708-5e74f48915ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:40 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5856fe29-0612-4940-96d5-60741b400ca4 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Created volume successfully. Sep 28 16:21:40 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b1ba7376-df59-4207-834f-32d662b54169 1073741824" returned: 0 in 0.414s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b1ba7376-df59-4207-834f-32d662b54169 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:40 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b1ba7376-df59-4207-834f-32d662b54169 Sep 28 16:21:40 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:40 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b1ba7376-df59-4207-834f-32d662b54169" returned: 0 in 0.250s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316eef26-7a19-4241-8e1d-5938a4f5e531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ba7376-df59-4207-834f-32d662b54169', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdd0472-eedf-4be3-b041-2572d3078375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:41 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Volume volume-b1ba7376-df59-4207-834f-32d662b54169 (b1ba7376-df59-4207-834f-32d662b54169): created successfully Sep 28 16:21:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdd0472-eedf-4be3-b041-2572d3078375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Flow 'volume_create_manager' (4d9e5c61-015c-4c44-8df7-325903251fed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:41 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7f850250-6a6d-4799-864e-81cfde9fcfea tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Created volume successfully. Sep 28 16:21:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "cinder-b1ba7376-df59-4207-834f-32d662b54169-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-b1ba7376-df59-4207-834f-32d662b54169-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "cinder-quobyte-b1ba7376-df59-4207-834f-32d662b54169" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-quobyte-b1ba7376-df59-4207-834f-32d662b54169" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:42 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bed886-76f5-4eaa-b16e-2729d831982c]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b1ba7376-df59-4207-834f-32d662b54169 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:42 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b1ba7376-df59-4207-834f-32d662b54169 Sep 28 16:21:42 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:42 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b1ba7376-df59-4207-834f-32d662b54169" returned: 0 in 0.417s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b1ba7376-df59-4207-834f-32d662b54169 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:42 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b1ba7376-df59-4207-834f-32d662b54169 Sep 28 16:21:42 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:42 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b1ba7376-df59-4207-834f-32d662b54169" returned: 0 in 0.287s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-quobyte-b1ba7376-df59-4207-834f-32d662b54169" released by "delete_volume" :: held 0.750s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:42 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Created reservations ['64009f50-a37c-4945-9148-b2e91b164c93', 'e068360e-cdf0-4d67-81bf-b7a2444dc2b8', 'e07102c3-9e4c-4ed4-abda-7821dff31449', '9c70b343-4db7-4723-b223-44e8b0c2ae82'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:43 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:21:43 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "cinder-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "cinder-quobyte-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-quobyte-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:43 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.346s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:43 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:43 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Deleted volume successfully. Sep 28 16:21:43 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deecae9-2e86-4e2f-91e3-6f48c5292833]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3ac2538a-93b7-4454-845e-2449f6d525d5 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-b1ba7376-df59-4207-834f-32d662b54169-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:43 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f Sep 28 16:21:43 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:43 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f" returned: 0 in 0.404s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:43 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f Sep 28 16:21:43 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:44 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f" returned: 0 in 0.270s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-quobyte-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f" released by "delete_volume" :: held 0.730s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Created reservations ['a072effe-fd22-468c-9a25-3b76b98d82f1', '8cb2df0d-b5e9-4bd4-b131-d3e050f5082e', '80b7bb69-f382-4480-be1a-5012d517a6c5', '9c967ef3-e7c1-435c-a6b3-4ea3bc57553c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:44 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:21:44 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "cinder-310fd37a-7584-434b-86f0-d9d04f648f2d-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-310fd37a-7584-434b-86f0-d9d04f648f2d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "cinder-quobyte-310fd37a-7584-434b-86f0-d9d04f648f2d" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:44 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.312s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:44 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Deleted volume successfully. Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-quobyte-310fd37a-7584-434b-86f0-d9d04f648f2d" acquired by "delete_volume" :: waited 0.041s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0f16a3f-06d6-4022-ba25-19b8bd9aa6bb tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-73347f56-4e83-4f9a-9eb9-8df25bfb8d1f-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae1c360-fd52-46fb-b0f6-7d5e63f096ea]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-310fd37a-7584-434b-86f0-d9d04f648f2d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:44 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-310fd37a-7584-434b-86f0-d9d04f648f2d Sep 28 16:21:44 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:44 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-310fd37a-7584-434b-86f0-d9d04f648f2d" returned: 0 in 0.368s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-310fd37a-7584-434b-86f0-d9d04f648f2d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:45 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-310fd37a-7584-434b-86f0-d9d04f648f2d Sep 28 16:21:45 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:45 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-310fd37a-7584-434b-86f0-d9d04f648f2d" returned: 0 in 0.291s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-quobyte-310fd37a-7584-434b-86f0-d9d04f648f2d" released by "delete_volume" :: held 0.710s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:45 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Created reservations ['5ea24474-bf7e-4487-bf23-757c5dc79e0e', 'e0b3f1a5-bd09-46ec-82fb-58dc21efa437', 'c1c63e32-3ddc-4199-9f8e-fcbbde2a9832', '038ce675-fb28-4038-8817-3a1a654afec0'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:45 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:21:45 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:45 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "cinder-cde83c00-a2b6-4659-ad0e-f9789179061b-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.274s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:45 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:45 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Deleted volume successfully. Sep 28 16:21:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-cde83c00-a2b6-4659-ad0e-f9789179061b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-38cf8122-010d-4ceb-ae72-90ce397945a1 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-310fd37a-7584-434b-86f0-d9d04f648f2d-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "cinder-quobyte-cde83c00-a2b6-4659-ad0e-f9789179061b" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-quobyte-cde83c00-a2b6-4659-ad0e-f9789179061b" acquired by "delete_volume" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:45 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0804cf1d-6263-4938-8ca8-4b20d9c4c275]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cde83c00-a2b6-4659-ad0e-f9789179061b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:45 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cde83c00-a2b6-4659-ad0e-f9789179061b Sep 28 16:21:45 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:46 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cde83c00-a2b6-4659-ad0e-f9789179061b" returned: 0 in 0.343s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cde83c00-a2b6-4659-ad0e-f9789179061b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:46 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cde83c00-a2b6-4659-ad0e-f9789179061b Sep 28 16:21:46 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:46 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-cde83c00-a2b6-4659-ad0e-f9789179061b" returned: 0 in 0.238s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-quobyte-cde83c00-a2b6-4659-ad0e-f9789179061b" released by "delete_volume" :: held 0.620s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Created reservations ['a658b237-3856-48d8-90ec-c83de28757d3', '656aa8ac-e007-48af-9adf-872139143ace', '9fd1e596-5810-42db-aeb4-31cfa526cd81', 'bbb5aa32-50a2-4c0a-866d-85e17cb80f24'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:46 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:21:46 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:46 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.273s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:46 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Deleted volume successfully. Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1108522-26bf-44b8-b1e3-0b5f138f17dd tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-cde83c00-a2b6-4659-ad0e-f9789179061b-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "cinder-2ba73f30-6e81-45e8-a955-3acd8b5252ec-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-2ba73f30-6e81-45e8-a955-3acd8b5252ec-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "cinder-quobyte-2ba73f30-6e81-45e8-a955-3acd8b5252ec" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-quobyte-2ba73f30-6e81-45e8-a955-3acd8b5252ec" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48f0e96-e147-4667-9f64-4ffa21047d76]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2ba73f30-6e81-45e8-a955-3acd8b5252ec {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:47 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2ba73f30-6e81-45e8-a955-3acd8b5252ec Sep 28 16:21:47 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:47 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2ba73f30-6e81-45e8-a955-3acd8b5252ec" returned: 0 in 0.397s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2ba73f30-6e81-45e8-a955-3acd8b5252ec {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:47 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2ba73f30-6e81-45e8-a955-3acd8b5252ec Sep 28 16:21:47 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:47 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2ba73f30-6e81-45e8-a955-3acd8b5252ec" returned: 0 in 0.248s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-quobyte-2ba73f30-6e81-45e8-a955-3acd8b5252ec" released by "delete_volume" :: held 0.693s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:47 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Created reservations ['e79e1768-23af-4c8a-95f2-4d4ec61d9693', 'ed9f8404-9c9e-4e52-acc3-a9f70f732bf1', '7ca8e4fd-ec6b-466d-8028-99f542304cc7', 'f1fe9a28-afe7-4e2a-926c-aaf9e4738df0'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:47 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:21:47 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:48 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "cinder-5256b49e-f6b4-465c-aee1-4f0289635c0f-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.265s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:48 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Deleted volume successfully. Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-5256b49e-f6b4-465c-aee1-4f0289635c0f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-13a2cf40-47cf-4fb2-93a9-40788dc166f8 tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-2ba73f30-6e81-45e8-a955-3acd8b5252ec-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "cinder-quobyte-5256b49e-f6b4-465c-aee1-4f0289635c0f" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-quobyte-5256b49e-f6b4-465c-aee1-4f0289635c0f" acquired by "delete_volume" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a52b6c-ac8b-4646-a606-eccaab0a5205]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5256b49e-f6b4-465c-aee1-4f0289635c0f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:48 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5256b49e-f6b4-465c-aee1-4f0289635c0f Sep 28 16:21:48 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:48 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5256b49e-f6b4-465c-aee1-4f0289635c0f" returned: 0 in 0.359s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5256b49e-f6b4-465c-aee1-4f0289635c0f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:48 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5256b49e-f6b4-465c-aee1-4f0289635c0f Sep 28 16:21:48 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:48 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-5256b49e-f6b4-465c-aee1-4f0289635c0f" returned: 0 in 0.243s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-quobyte-5256b49e-f6b4-465c-aee1-4f0289635c0f" released by "delete_volume" :: held 0.641s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Created reservations ['c7abdd43-192a-4a03-b3b3-cbe0d9fd686b', 'e8bcc418-076a-49c6-af5b-3fb81faec140', '56635a90-65b4-4a10-9a98-0f74443f0d2a', 'da2e4044-dd81-423a-ac65-25eb2400abc2'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:48 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:21:48 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:49 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.239s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:49 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Deleted volume successfully. Sep 28 16:21:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c0fd94b4-e66c-48b6-a5a4-1852a71a5d5c tempest-CreateVolumesFromSourceVolumeTest-1558789563 None] Lock "cinder-5256b49e-f6b4-465c-aee1-4f0289635c0f-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:54 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Flow 'volume_create_manager' (84b56dfc-cec7-4ca6-a39d-426c08a0684a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e84a3c-9ae6-44db-b20d-fe8379b06c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e84a3c-9ae6-44db-b20d-fe8379b06c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9972363-d52c-475c-a2d3-85a64b855f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38827ad6c48e4f82bf3c5c7acfd85893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:55Z,use_quota=True,user_id='6ce0c28b3270497d917b28af87dd2526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96fa3cb8-0ed7-4475-aaca-36d0eee2619f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96fa3cb8-0ed7-4475-aaca-36d0eee2619f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b685c2-f3f4-4730-8108-80df3616f44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:54 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:21:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b685c2-f3f4-4730-8108-80df3616f44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd9972363-d52c-475c-a2d3-85a64b855f27', 'volume_name': 'volume-d9972363-d52c-475c-a2d3-85a64b855f27', 'volume_size': 1, 'image_id': 'a1841f07-505f-4374-b653-b1f5d296befe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1841f07-505f-4374-b653-b1f5d296befe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c71b73f5b12b5773cfec1ba68482dbe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38827ad6c48e4f82bf3c5c7acfd85893', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc4fe9fa19925b465470aa32d582c5d54590853b55ff20c308c7b3c8e42bfd5683ffe01982030bf1d02293b1d88a8e3151eb867fd3410a3c6a19aada14be035c', 'id': 'a1841f07-505f-4374-b653-b1f5d296befe', 'created_at': datetime.datetime(2026, 9, 28, 14, 21, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 21, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1841f07-505f-4374-b653-b1f5d296befe/file', 'properties': {}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2487e7-fcd9-4521-bc7b-7d5fe7643793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2487e7-fcd9-4521-bc7b-7d5fe7643793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ed6d1a-be9d-4940-9916-56fc655a35f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:55 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Volume d9972363-d52c-475c-a2d3-85a64b855f27: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d9972363-d52c-475c-a2d3-85a64b855f27', 'volume_size': 1, 'image_id': 'a1841f07-505f-4374-b653-b1f5d296befe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1841f07-505f-4374-b653-b1f5d296befe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c71b73f5b12b5773cfec1ba68482dbe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38827ad6c48e4f82bf3c5c7acfd85893', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc4fe9fa19925b465470aa32d582c5d54590853b55ff20c308c7b3c8e42bfd5683ffe01982030bf1d02293b1d88a8e3151eb867fd3410a3c6a19aada14be035c', 'id': 'a1841f07-505f-4374-b653-b1f5d296befe', 'created_at': datetime.datetime(2026, 9, 28, 14, 21, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 21, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1841f07-505f-4374-b653-b1f5d296befe/file', 'properties': {}}, 'image_service': } Sep 28 16:21:55 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Trying to clone d9972363-d52c-475c-a2d3-85a64b855f27 from image a1841f07-505f-4374-b653-b1f5d296befe at location (None, [{'url': 'file:///opt/stack/data/glance/images/a1841f07-505f-4374-b653-b1f5d296befe', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:21:55 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:21:55 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Image download 0.00 MB at 0.00 MB/s Sep 28 16:21:55 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84c9e50-03b1-4c58-8180-2bb012021464]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:55 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD Sep 28 16:21:55 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:55 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:55 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD Sep 28 16:21:55 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:56 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD" returned: 1 in 0.323s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Temporary image a1841f07-505f-4374-b653-b1f5d296befe is fetched for user 6ce0c28b3270497d917b28af87dd2526. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e72e5d-20a8-4f38-96e2-60d7df1e05ba]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:56 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD Sep 28 16:21:56 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:56 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD" returned: 0 in 0.315s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:56 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD Sep 28 16:21:56 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:56 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9972363-d52c-475c-a2d3-85a64b855f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38827ad6c48e4f82bf3c5c7acfd85893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:55Z,use_quota=True,user_id='6ce0c28b3270497d917b28af87dd2526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Creating volume d9972363-d52c-475c-a2d3-85a64b855f27 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:56 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:21:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d9972363-d52c-475c-a2d3-85a64b855f27 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:56 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d9972363-d52c-475c-a2d3-85a64b855f27 1073741824 Sep 28 16:21:56 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:57 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d9972363-d52c-475c-a2d3-85a64b855f27 1073741824" returned: 0 in 0.454s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d9972363-d52c-475c-a2d3-85a64b855f27 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:57 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d9972363-d52c-475c-a2d3-85a64b855f27 Sep 28 16:21:57 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:57 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d9972363-d52c-475c-a2d3-85a64b855f27" returned: 0 in 0.293s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:57 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Attempting download of a1841f07-505f-4374-b653-b1f5d296befe ((None, [{'url': 'file:///opt/stack/data/glance/images/a1841f07-505f-4374-b653-b1f5d296befe', 'metadata': {}}])) to volume d9972363-d52c-475c-a2d3-85a64b855f27. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:21:57 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[21893db2-d92e-4944-a91a-c56ee626e67f]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1841f07-505f-4374-b653-b1f5d296befe_xvpkoada {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:57 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1841f07-505f-4374-b653-b1f5d296befe_xvpkoada Sep 28 16:21:57 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:58 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1841f07-505f-4374-b653-b1f5d296befe_xvpkoada" returned: 0 in 0.360s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1841f07-505f-4374-b653-b1f5d296befe_xvpkoada {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:58 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1841f07-505f-4374-b653-b1f5d296befe_xvpkoada Sep 28 16:21:58 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:58 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1841f07-505f-4374-b653-b1f5d296befe_xvpkoada" returned: 1 in 0.312s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1841f07-505f-4374-b653-b1f5d296befe_xvpkoada' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:21:58 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3819f1-2c56-43e1-bfa9-a249e1f27f95]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:58 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD Sep 28 16:21:58 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:58 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:58 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD Sep 28 16:21:58 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:59 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:21:59 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] a1841f07-505f-4374-b653-b1f5d296befe was raw, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:21:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d9972363-d52c-475c-a2d3-85a64b855f27 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:59 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d9972363-d52c-475c-a2d3-85a64b855f27 Sep 28 16:21:59 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:59 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d9972363-d52c-475c-a2d3-85a64b855f27" returned: 0 in 0.468s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:59 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a1841f07-505f-4374-b653-b1f5d296befe_bk6uxjqddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d9972363-d52c-475c-a2d3-85a64b855f27 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:21:59 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 16:21:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d9972363-d52c-475c-a2d3-85a64b855f27 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:59 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d9972363-d52c-475c-a2d3-85a64b855f27 1G Sep 28 16:21:59 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:59 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d9972363-d52c-475c-a2d3-85a64b855f27 1G" returned: 0 in 0.386s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:59 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Downloaded image a1841f07-505f-4374-b653-b1f5d296befe ((None, [{'url': 'file:///opt/stack/data/glance/images/a1841f07-505f-4374-b653-b1f5d296befe', 'metadata': {}}])) to volume d9972363-d52c-475c-a2d3-85a64b855f27 successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:21:59 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Temporary image a1841f07-505f-4374-b653-b1f5d296befe for user 6ce0c28b3270497d917b28af87dd2526 is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:21:59 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Marking volume d9972363-d52c-475c-a2d3-85a64b855f27 as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:21:59 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Copying metadata from image a1841f07-505f-4374-b653-b1f5d296befe to d9972363-d52c-475c-a2d3-85a64b855f27. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:21:59 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Creating volume glance metadata for volume d9972363-d52c-475c-a2d3-85a64b855f27 backed by image a1841f07-505f-4374-b653-b1f5d296befe with: {'image_id': 'a1841f07-505f-4374-b653-b1f5d296befe', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2c71b73f5b12b5773cfec1ba68482dbe', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:21:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ed6d1a-be9d-4940-9916-56fc655a35f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9972363-d52c-475c-a2d3-85a64b855f27', 'volume_size': 1, 'image_id': 'a1841f07-505f-4374-b653-b1f5d296befe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1841f07-505f-4374-b653-b1f5d296befe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c71b73f5b12b5773cfec1ba68482dbe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38827ad6c48e4f82bf3c5c7acfd85893', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc4fe9fa19925b465470aa32d582c5d54590853b55ff20c308c7b3c8e42bfd5683ffe01982030bf1d02293b1d88a8e3151eb867fd3410a3c6a19aada14be035c', 'id': 'a1841f07-505f-4374-b653-b1f5d296befe', 'created_at': datetime.datetime(2026, 9, 28, 14, 21, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 21, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1841f07-505f-4374-b653-b1f5d296befe/file', 'properties': {}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4709765c-fb33-496e-9ed7-242394d78ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:00 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Volume volume-d9972363-d52c-475c-a2d3-85a64b855f27 (d9972363-d52c-475c-a2d3-85a64b855f27): created successfully Sep 28 16:22:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4709765c-fb33-496e-9ed7-242394d78ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Flow 'volume_create_manager' (84b56dfc-cec7-4ca6-a39d-426c08a0684a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c9fceeb4-281d-462d-9a9c-33b5a3141222 tempest-VolumeImageDependencyTests-42692136 None] Created volume successfully. Sep 28 16:22:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] Acquiring lock "cinder-d9972363-d52c-475c-a2d3-85a64b855f27-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] Lock "cinder-d9972363-d52c-475c-a2d3-85a64b855f27-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] Acquiring lock "cinder-quobyte-d9972363-d52c-475c-a2d3-85a64b855f27" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] Lock "cinder-quobyte-d9972363-d52c-475c-a2d3-85a64b855f27" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:01 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c64880d-a8d7-445a-bcde-3d5c20b7da07]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d9972363-d52c-475c-a2d3-85a64b855f27 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:01 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d9972363-d52c-475c-a2d3-85a64b855f27 Sep 28 16:22:01 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:01 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d9972363-d52c-475c-a2d3-85a64b855f27" returned: 0 in 0.375s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d9972363-d52c-475c-a2d3-85a64b855f27 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:01 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d9972363-d52c-475c-a2d3-85a64b855f27 Sep 28 16:22:01 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:02 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d9972363-d52c-475c-a2d3-85a64b855f27" returned: 0 in 0.254s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] Lock "cinder-quobyte-d9972363-d52c-475c-a2d3-85a64b855f27" released by "delete_volume" :: held 0.674s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:02 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] Created reservations ['d2139dbf-3597-4526-a606-6310d2884986', '8ad8edff-c67f-4b26-a537-7e700f85eb3a', 'ea7e0219-b48c-4cd9-a9d2-ed2ba84a898f', '64b96750-072a-4898-86c9-e65cbd565dd6'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:02 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:22:02 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:02 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.277s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:02 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:02 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] Deleted volume successfully. Sep 28 16:22:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-12fb993c-fdfd-4ddd-92fd-55f81d59c66c tempest-VolumeImageDependencyTests-42692136 None] Lock "cinder-d9972363-d52c-475c-a2d3-85a64b855f27-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Flow 'volume_create_manager' (7febeebf-f72e-402a-8acb-8e3d665bcb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7efdc5-c97d-4f50-9d5b-9362ac8023fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7efdc5-c97d-4f50-9d5b-9362ac8023fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-258725627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de526d7-3acb-4b69-a2eb-f06819176e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ed438196fc4cd7802b103e77c8fb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:16Z,use_quota=True,user_id='6a149d2d30cb412ba186bdbfce6519c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d70b0ef-6e4a-4974-ae69-308abb357f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d70b0ef-6e4a-4974-ae69-308abb357f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0c5f35-26ca-4944-9488-f56f8a103497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0c5f35-26ca-4944-9488-f56f8a103497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7de526d7-3acb-4b69-a2eb-f06819176e6d', 'volume_name': 'volume-7de526d7-3acb-4b69-a2eb-f06819176e6d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37495bc-b935-4914-9ff5-a55c624ed1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37495bc-b935-4914-9ff5-a55c624ed1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa09927-e1a3-40bd-bf02-4aac2cc8f7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:15 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Volume 7de526d7-3acb-4b69-a2eb-f06819176e6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7de526d7-3acb-4b69-a2eb-f06819176e6d', 'volume_size': 1} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-258725627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de526d7-3acb-4b69-a2eb-f06819176e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ed438196fc4cd7802b103e77c8fb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:16Z,use_quota=True,user_id='6a149d2d30cb412ba186bdbfce6519c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Creating volume 7de526d7-3acb-4b69-a2eb-f06819176e6d {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:15 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:16 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d 1073741824 Sep 28 16:22:16 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Flow 'volume_create_manager' (6913c14f-4605-4ddc-9fd4-fd6bf06c489a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d5ea13-7f0c-4e06-91bb-73791d2015c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d5ea13-7f0c-4e06-91bb-73791d2015c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-611365156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c827d12-ff6b-4679-9ef6-470d1c8bbef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdde0572603e4167a21943ba996faade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:16Z,use_quota=True,user_id='875c51545e54451bb1f6c224b46b9f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92014eeb-9ad8-46d4-89c8-9b83118ac942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92014eeb-9ad8-46d4-89c8-9b83118ac942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f719388d-8bc0-4491-b196-db0e5782aab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f719388d-8bc0-4491-b196-db0e5782aab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c827d12-ff6b-4679-9ef6-470d1c8bbef9', 'volume_name': 'volume-8c827d12-ff6b-4679-9ef6-470d1c8bbef9', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da380c0e-9804-4a7e-bca0-be49c77772a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da380c0e-9804-4a7e-bca0-be49c77772a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747a10b6-66ee-4883-a080-7cfa6a8d3c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:16 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Volume 8c827d12-ff6b-4679-9ef6-470d1c8bbef9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c827d12-ff6b-4679-9ef6-470d1c8bbef9', 'volume_size': 1} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Flow 'volume_create_manager' (14132793-d4d0-4885-a4f3-db6153182b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbec26b-7ba8-4db5-a442-856862dc5267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbec26b-7ba8-4db5-a442-856862dc5267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1965517114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=498fe0d5-50b1-4df9-a5ca-69b061e6f3af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66427aed5962406fa73be45c456c6172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:17Z,use_quota=True,user_id='110faecf467d4b0890e1eb4180d9cb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:16 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562d56e2-1239-4fad-8d16-0a18be51a629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562d56e2-1239-4fad-8d16-0a18be51a629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee673c3-8b0f-457e-a9e6-8b39037e43f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee673c3-8b0f-457e-a9e6-8b39037e43f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '498fe0d5-50b1-4df9-a5ca-69b061e6f3af', 'volume_name': 'volume-498fe0d5-50b1-4df9-a5ca-69b061e6f3af', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45681ac5-0255-465d-a04e-33afe3153bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45681ac5-0255-465d-a04e-33afe3153bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0199d3d-7537-4759-9c30-e165b506ae78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:16 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Volume 498fe0d5-50b1-4df9-a5ca-69b061e6f3af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-498fe0d5-50b1-4df9-a5ca-69b061e6f3af', 'volume_size': 1} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d 1073741824" returned: 0 in 0.722s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:16 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d Sep 28 16:22:16 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=99,cinder:UPDATE=128,cinder:INSERT=36,cinder:DELETE=11 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:22:17 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d" returned: 0 in 0.330s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.958s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-611365156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c827d12-ff6b-4679-9ef6-470d1c8bbef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdde0572603e4167a21943ba996faade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:16Z,use_quota=True,user_id='875c51545e54451bb1f6c224b46b9f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Creating volume 8c827d12-ff6b-4679-9ef6-470d1c8bbef9 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:17 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c827d12-ff6b-4679-9ef6-470d1c8bbef9 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:17 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c827d12-ff6b-4679-9ef6-470d1c8bbef9 1073741824 Sep 28 16:22:17 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Flow 'volume_create_manager' (a01e5979-0690-4b39-b936-e55e03b40b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb1bf79-e7fa-4925-9450-fa2edce670e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa09927-e1a3-40bd-bf02-4aac2cc8f7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7de526d7-3acb-4b69-a2eb-f06819176e6d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c349429a-d22f-44a9-b9a2-9758189b491d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb1bf79-e7fa-4925-9450-fa2edce670e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1197263508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4121c64-282a-435d-95ed-a657c9f6789d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66427aed5962406fa73be45c456c6172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:17Z,use_quota=True,user_id='110faecf467d4b0890e1eb4180d9cb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398dde01-c71c-4eed-a506-f51b15b3e03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398dde01-c71c-4eed-a506-f51b15b3e03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b90ca1-c84b-48ef-8dfe-9e1ef21c596b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b90ca1-c84b-48ef-8dfe-9e1ef21c596b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4121c64-282a-435d-95ed-a657c9f6789d', 'volume_name': 'volume-d4121c64-282a-435d-95ed-a657c9f6789d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feef91a3-fcaa-45b3-b4bc-a36b676835f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feef91a3-fcaa-45b3-b4bc-a36b676835f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba442a6-721b-4e5c-9f41-c8a3d7e3c09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:17 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Volume d4121c64-282a-435d-95ed-a657c9f6789d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4121c64-282a-435d-95ed-a657c9f6789d', 'volume_size': 1} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:17 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Volume volume-7de526d7-3acb-4b69-a2eb-f06819176e6d (7de526d7-3acb-4b69-a2eb-f06819176e6d): created successfully Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c349429a-d22f-44a9-b9a2-9758189b491d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Flow 'volume_create_manager' (7febeebf-f72e-402a-8acb-8e3d665bcb93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:17 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-29d22fff-4de9-4d13-a715-72507ba0d372 tempest-VolumeDependencyTests-1333096594 None] Created volume successfully. Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=91,cinder:UPDATE=147,cinder:INSERT=34,cinder:DELETE=14 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Flow 'volume_create_manager' (edecbc1b-de1b-4156-9dc0-05f23fa50552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3882bf-92fe-4be9-addd-fab539fd2184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3882bf-92fe-4be9-addd-fab539fd2184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-706306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16034720-04f7-4cff-8642-fdfe281567dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66427aed5962406fa73be45c456c6172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:17Z,use_quota=True,user_id='110faecf467d4b0890e1eb4180d9cb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce8a8ec-378c-4b5e-802c-113ed1805b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce8a8ec-378c-4b5e-802c-113ed1805b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ffd9ec-76e3-4b8b-ba3f-28d44ded08f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ffd9ec-76e3-4b8b-ba3f-28d44ded08f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16034720-04f7-4cff-8642-fdfe281567dc', 'volume_name': 'volume-16034720-04f7-4cff-8642-fdfe281567dc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9338d902-6eb6-4cbd-bff4-df7470f0bb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9338d902-6eb6-4cbd-bff4-df7470f0bb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9924f711-3d95-4ca6-8453-ee25f287fe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:17 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Volume 16034720-04f7-4cff-8642-fdfe281567dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16034720-04f7-4cff-8642-fdfe281567dc', 'volume_size': 1} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:17 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c827d12-ff6b-4679-9ef6-470d1c8bbef9 1073741824" returned: 0 in 0.709s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c827d12-ff6b-4679-9ef6-470d1c8bbef9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:17 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c827d12-ff6b-4679-9ef6-470d1c8bbef9 Sep 28 16:22:17 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-623b4f22-9d08-45d2-a589-1bed62d978bd tempest-VolumeDependencyTests-1333096594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:18 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Flow 'volume_create_manager' (e8ea7036-f959-46c3-8dce-d21160ddc8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2215f5-147a-46b1-b832-9c93ac6c597a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c827d12-ff6b-4679-9ef6-470d1c8bbef9" returned: 0 in 0.492s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.659s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1965517114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=498fe0d5-50b1-4df9-a5ca-69b061e6f3af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66427aed5962406fa73be45c456c6172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:17Z,use_quota=True,user_id='110faecf467d4b0890e1eb4180d9cb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Creating volume 498fe0d5-50b1-4df9-a5ca-69b061e6f3af {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:18 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-498fe0d5-50b1-4df9-a5ca-69b061e6f3af 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2215f5-147a-46b1-b832-9c93ac6c597a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1014029383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e372d3c5-6cd2-47b4-90b3-274b2b0177a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66427aed5962406fa73be45c456c6172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:18Z,use_quota=True,user_id='110faecf467d4b0890e1eb4180d9cb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3db9d01-060d-4abf-a132-26e93c675241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:18 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-498fe0d5-50b1-4df9-a5ca-69b061e6f3af 1073741824 Sep 28 16:22:18 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3db9d01-060d-4abf-a132-26e93c675241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acdd2ba4-a81a-4de4-9729-dc365ee64b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acdd2ba4-a81a-4de4-9729-dc365ee64b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e372d3c5-6cd2-47b4-90b3-274b2b0177a9', 'volume_name': 'volume-e372d3c5-6cd2-47b4-90b3-274b2b0177a9', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e48f32-486a-4e73-aa9f-03e01cbaa67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e48f32-486a-4e73-aa9f-03e01cbaa67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bc5885-f446-4c9e-8db7-64dc769f21cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:18 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Volume e372d3c5-6cd2-47b4-90b3-274b2b0177a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e372d3c5-6cd2-47b4-90b3-274b2b0177a9', 'volume_size': 1} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747a10b6-66ee-4883-a080-7cfa6a8d3c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c827d12-ff6b-4679-9ef6-470d1c8bbef9', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2807b333-00e7-4e9f-8a20-b39c805a9b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:18 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Volume volume-8c827d12-ff6b-4679-9ef6-470d1c8bbef9 (8c827d12-ff6b-4679-9ef6-470d1c8bbef9): created successfully Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2807b333-00e7-4e9f-8a20-b39c805a9b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Flow 'volume_create_manager' (6913c14f-4605-4ddc-9fd4-fd6bf06c489a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:18 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-79642d9d-6e77-4032-8a35-4c7485dabae9 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Created volume successfully. Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Flow 'volume_create_manager' (7874d46d-5ad4-4ff8-9257-dc7b283795c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd6c24d-91ac-41b6-9b0a-3a9f5abcd255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd6c24d-91ac-41b6-9b0a-3a9f5abcd255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-395882931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16551d4-ddb8-40e5-8b3d-d7cc402f65f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66427aed5962406fa73be45c456c6172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:19Z,use_quota=True,user_id='110faecf467d4b0890e1eb4180d9cb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5479a1b0-8708-4f04-be98-589e172641cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5479a1b0-8708-4f04-be98-589e172641cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2aa78fd-3b07-4678-a7fe-2c2ffcfc4867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2aa78fd-3b07-4678-a7fe-2c2ffcfc4867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b16551d4-ddb8-40e5-8b3d-d7cc402f65f7', 'volume_name': 'volume-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580fd1c4-be6e-49d9-a799-01cace4dc24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580fd1c4-be6e-49d9-a799-01cace4dc24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9f1e69-bd0f-4a33-aef4-b8afc5b8e6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:18 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Volume b16551d4-ddb8-40e5-8b3d-d7cc402f65f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7', 'volume_size': 1} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:18 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-498fe0d5-50b1-4df9-a5ca-69b061e6f3af 1073741824" returned: 0 in 0.576s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-498fe0d5-50b1-4df9-a5ca-69b061e6f3af {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:19 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-498fe0d5-50b1-4df9-a5ca-69b061e6f3af Sep 28 16:22:19 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:19 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-498fe0d5-50b1-4df9-a5ca-69b061e6f3af" returned: 0 in 0.343s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.070s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1197263508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4121c64-282a-435d-95ed-a657c9f6789d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66427aed5962406fa73be45c456c6172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:17Z,use_quota=True,user_id='110faecf467d4b0890e1eb4180d9cb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Creating volume d4121c64-282a-435d-95ed-a657c9f6789d {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:19 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d4121c64-282a-435d-95ed-a657c9f6789d 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:19 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d4121c64-282a-435d-95ed-a657c9f6789d 1073741824 Sep 28 16:22:19 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0199d3d-7537-4759-9c30-e165b506ae78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-498fe0d5-50b1-4df9-a5ca-69b061e6f3af', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6e0ba0-f4b6-4cf6-87f1-1be3fec3268f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:19 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Volume volume-498fe0d5-50b1-4df9-a5ca-69b061e6f3af (498fe0d5-50b1-4df9-a5ca-69b061e6f3af): created successfully Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6e0ba0-f4b6-4cf6-87f1-1be3fec3268f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Flow 'volume_create_manager' (14132793-d4d0-4885-a4f3-db6153182b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-85aaa40d-544b-41ad-9727-3480ece715f3 tempest-CreateVolumesFromImageTest-976554443 None] Created volume successfully. Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Flow 'volume_create_manager' (d7e5da29-aad2-4b71-adb1-1daf154af8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ea2162-0d59-4911-8731-b2b56e978ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ea2162-0d59-4911-8731-b2b56e978ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1393897060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2646bf5f-c859-4581-9c37-74ae7a3be3d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdde0572603e4167a21943ba996faade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:19Z,use_quota=True,user_id='875c51545e54451bb1f6c224b46b9f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7add9992-761b-47b2-bdf2-28a1afa89f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7add9992-761b-47b2-bdf2-28a1afa89f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6d83ac-e3d9-4ce7-946c-974262a7107f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6d83ac-e3d9-4ce7-946c-974262a7107f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2646bf5f-c859-4581-9c37-74ae7a3be3d5', 'volume_name': 'volume-2646bf5f-c859-4581-9c37-74ae7a3be3d5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fea670f-6ad6-4f0a-95b3-0005e9d452c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fea670f-6ad6-4f0a-95b3-0005e9d452c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5641de3-ada4-4072-a157-02671aa81777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:19 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Volume 2646bf5f-c859-4581-9c37-74ae7a3be3d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2646bf5f-c859-4581-9c37-74ae7a3be3d5', 'volume_size': 1} Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:19 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d4121c64-282a-435d-95ed-a657c9f6789d 1073741824" returned: 0 in 0.595s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d4121c64-282a-435d-95ed-a657c9f6789d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:20 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d4121c64-282a-435d-95ed-a657c9f6789d Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:20 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Flow 'volume_create_manager' (c24fcae3-f36e-4dbe-971a-7f971297ca9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745c73d3-5075-4971-81ca-0b51d4b32653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745c73d3-5075-4971-81ca-0b51d4b32653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2048701945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ca1813-2657-4da0-892c-cad93ee4c5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdde0572603e4167a21943ba996faade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:20Z,use_quota=True,user_id='875c51545e54451bb1f6c224b46b9f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3f2b6b-0b75-4d86-9d40-1ad831aaffb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3f2b6b-0b75-4d86-9d40-1ad831aaffb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a602108-c22f-440e-8c81-4a9b112da76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a602108-c22f-440e-8c81-4a9b112da76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3ca1813-2657-4da0-892c-cad93ee4c5c2', 'volume_name': 'volume-c3ca1813-2657-4da0-892c-cad93ee4c5c2', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fcb65c-5858-4a2c-a9b2-2ba8cdd33b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fcb65c-5858-4a2c-a9b2-2ba8cdd33b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37b608f-5ca5-47cf-b3bb-c02c48794f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:20 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Volume c3ca1813-2657-4da0-892c-cad93ee4c5c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3ca1813-2657-4da0-892c-cad93ee4c5c2', 'volume_size': 1} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:20 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d4121c64-282a-435d-95ed-a657c9f6789d" returned: 0 in 0.456s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.845s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-706306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16034720-04f7-4cff-8642-fdfe281567dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66427aed5962406fa73be45c456c6172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:17Z,use_quota=True,user_id='110faecf467d4b0890e1eb4180d9cb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Creating volume 16034720-04f7-4cff-8642-fdfe281567dc {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:20 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-16034720-04f7-4cff-8642-fdfe281567dc 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba442a6-721b-4e5c-9f41-c8a3d7e3c09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4121c64-282a-435d-95ed-a657c9f6789d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260d6e6c-09fa-4d79-8634-b2572f66d2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:20 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-16034720-04f7-4cff-8642-fdfe281567dc 1073741824 Sep 28 16:22:20 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:20 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Volume volume-d4121c64-282a-435d-95ed-a657c9f6789d (d4121c64-282a-435d-95ed-a657c9f6789d): created successfully Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260d6e6c-09fa-4d79-8634-b2572f66d2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Flow 'volume_create_manager' (a01e5979-0690-4b39-b936-e55e03b40b94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:20 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b06531bd-fae0-4d57-8ebe-948a6f1b1f09 tempest-CreateVolumesFromImageTest-976554443 None] Created volume successfully. Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Flow 'volume_create_manager' (69424776-fcdd-4408-a287-1312c87759d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6719a84-f23f-4783-bb2c-a7e5af86b690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6719a84-f23f-4783-bb2c-a7e5af86b690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-494669502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91bf561a-a836-4323-9156-f04909fe2d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdde0572603e4167a21943ba996faade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:21Z,use_quota=True,user_id='875c51545e54451bb1f6c224b46b9f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a48821c-52ff-4061-99a2-6549b17252c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a48821c-52ff-4061-99a2-6549b17252c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d90e5f-a0d6-41a0-abf5-ff7774ed0628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d90e5f-a0d6-41a0-abf5-ff7774ed0628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91bf561a-a836-4323-9156-f04909fe2d74', 'volume_name': 'volume-91bf561a-a836-4323-9156-f04909fe2d74', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b056394a-9a2a-44a0-a001-63d69459884e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b056394a-9a2a-44a0-a001-63d69459884e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2de2bb-e1f4-4c9a-bd51-59fcad670673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:20 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Volume 91bf561a-a836-4323-9156-f04909fe2d74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91bf561a-a836-4323-9156-f04909fe2d74', 'volume_size': 1} Sep 28 16:22:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Flow 'volume_create_manager' (c0f9b9c5-8918-4778-9ef2-184d65b47d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ec4dae-aba3-40c6-9469-e3809e055174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ec4dae-aba3-40c6-9469-e3809e055174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329a5def-ebb6-4274-973a-a05b8baaa3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8614d0bff70045a4a11c0bbad9aaac87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:21Z,use_quota=True,user_id='f592ecc313ee400f8eb15bf00189d85c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51adc011-e78d-439a-8fff-7fb4344270b7),volume_type_id=51adc011-e78d-439a-8fff-7fb4344270b7)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c1c5a6-3962-4d23-a731-324bc77a8457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c1c5a6-3962-4d23-a731-324bc77a8457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956c968d-5b20-4f8b-a66b-ffb95879ba15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:22:21 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-16034720-04f7-4cff-8642-fdfe281567dc 1073741824" returned: 0 in 0.809s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Flow 'volume_create_manager' (7c6dbd6c-3f07-4dad-b566-a6dc4eda6282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a37b86a-7072-4120-ba88-f4743fbcc079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a37b86a-7072-4120-ba88-f4743fbcc079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1336768091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e515f349-9a85-4064-bfeb-c2eb087aa523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdde0572603e4167a21943ba996faade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:21Z,use_quota=True,user_id='875c51545e54451bb1f6c224b46b9f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b0e5ad-461f-4353-9bca-f4e7f331e910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b0e5ad-461f-4353-9bca-f4e7f331e910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8bd5a31-cf29-44b5-b1fb-c9561f87f93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8bd5a31-cf29-44b5-b1fb-c9561f87f93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e515f349-9a85-4064-bfeb-c2eb087aa523', 'volume_name': 'volume-e515f349-9a85-4064-bfeb-c2eb087aa523', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c016f9-7731-4415-b761-4b346f425ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c016f9-7731-4415-b761-4b346f425ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff840ee4-c7ce-497c-9bb6-3f3f2016e7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:21 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Volume e515f349-9a85-4064-bfeb-c2eb087aa523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e515f349-9a85-4064-bfeb-c2eb087aa523', 'volume_size': 1} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-16034720-04f7-4cff-8642-fdfe281567dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:21 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-16034720-04f7-4cff-8642-fdfe281567dc Sep 28 16:22:21 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Flow 'volume_create_manager' (509b975d-0e45-4aa9-837d-faa6c0009459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66eb0ad5-4751-4541-9d01-ea2b2cde438b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66eb0ad5-4751-4541-9d01-ea2b2cde438b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-692936870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a24128-2cd7-44b8-a7e7-f596b6a84cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdde0572603e4167a21943ba996faade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:21Z,use_quota=True,user_id='875c51545e54451bb1f6c224b46b9f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84fc528-eaf5-4d8e-a25a-5d05fc45e745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84fc528-eaf5-4d8e-a25a-5d05fc45e745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1be6c6-daae-4f96-a021-e29253d5a12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1be6c6-daae-4f96-a021-e29253d5a12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2a24128-2cd7-44b8-a7e7-f596b6a84cf5', 'volume_name': 'volume-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37aef700-bb0d-4995-a959-01ff08a8b456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37aef700-bb0d-4995-a959-01ff08a8b456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c3ce8f-7b0b-4d50-972a-d282e4f111c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:21 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Volume a2a24128-2cd7-44b8-a7e7-f596b6a84cf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5', 'volume_size': 1} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956c968d-5b20-4f8b-a66b-ffb95879ba15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '329a5def-ebb6-4274-973a-a05b8baaa3d8', 'volume_name': 'volume-329a5def-ebb6-4274-973a-a05b8baaa3d8', 'volume_size': 1, 'image_id': 'd9edfd46-f870-4b20-a58e-f793ea8baec0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d9edfd46-f870-4b20-a58e-f793ea8baec0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f365f724ef7f661560a3f6f03b20b6b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8614d0bff70045a4a11c0bbad9aaac87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1c9353e46987f6b0279bb97b372a98223b12cb1b72ec728259d6453eb48607533689ff47a3fdd98acb54ad9041ab378d401b96119bda4f7df26a7466b1404659', 'id': 'd9edfd46-f870-4b20-a58e-f793ea8baec0', 'created_at': datetime.datetime(2026, 9, 28, 14, 22, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 22, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d9edfd46-f870-4b20-a58e-f793ea8baec0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f38e77-aa39-4efe-b8bc-1d2934b5d923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f38e77-aa39-4efe-b8bc-1d2934b5d923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7027674-c80d-4268-9458-ac9ca44be941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:21 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Volume 329a5def-ebb6-4274-973a-a05b8baaa3d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-329a5def-ebb6-4274-973a-a05b8baaa3d8', 'volume_size': 1, 'image_id': 'd9edfd46-f870-4b20-a58e-f793ea8baec0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d9edfd46-f870-4b20-a58e-f793ea8baec0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f365f724ef7f661560a3f6f03b20b6b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8614d0bff70045a4a11c0bbad9aaac87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1c9353e46987f6b0279bb97b372a98223b12cb1b72ec728259d6453eb48607533689ff47a3fdd98acb54ad9041ab378d401b96119bda4f7df26a7466b1404659', 'id': 'd9edfd46-f870-4b20-a58e-f793ea8baec0', 'created_at': datetime.datetime(2026, 9, 28, 14, 22, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 22, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d9edfd46-f870-4b20-a58e-f793ea8baec0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Trying to clone 329a5def-ebb6-4274-973a-a05b8baaa3d8 from image d9edfd46-f870-4b20-a58e-f793ea8baec0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d9edfd46-f870-4b20-a58e-f793ea8baec0', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:22:21 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-16034720-04f7-4cff-8642-fdfe281567dc" returned: 0 in 0.289s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-623b4f22-9d08-45d2-a589-1bed62d978bd tempest-VolumeDependencyTests-1333096594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.456s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9924f711-3d95-4ca6-8453-ee25f287fe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16034720-04f7-4cff-8642-fdfe281567dc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55262dc8-6818-4764-a515-df754719d971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-623b4f22-9d08-45d2-a589-1bed62d978bd tempest-VolumeDependencyTests-1333096594 None] Creating offline snapshot feb2801b-b121-4959-87b8-bfce9afe9307 of volume 7de526d7-3acb-4b69-a2eb-f06819176e6d {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:22:21 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Volume volume-16034720-04f7-4cff-8642-fdfe281567dc (16034720-04f7-4cff-8642-fdfe281567dc): created successfully Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55262dc8-6818-4764-a515-df754719d971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Flow 'volume_create_manager' (edecbc1b-de1b-4156-9dc0-05f23fa50552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:22:21 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Image download 0.00 MB at 0.00 MB/s Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d437302f-de8c-41d1-9348-e7cc8ebc02cc]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-623b4f22-9d08-45d2-a589-1bed62d978bd tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3f865a99-beeb-4837-ae0d-c9f52d2d1bcf tempest-CreateVolumesFromImageTest-976554443 None] Created volume successfully. Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2e3db7-2062-4d09-968b-d79ebd8193fa]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:21 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d Sep 28 16:22:21 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:22 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD Sep 28 16:22:22 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:22 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-623b4f22-9d08-45d2-a589-1bed62d978bd tempest-VolumeDependencyTests-1333096594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d" returned: 0 in 0.385s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-623b4f22-9d08-45d2-a589-1bed62d978bd tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:22 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307 1G Sep 28 16:22:22 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:22 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:22 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD Sep 28 16:22:22 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:22 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:22:22 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Temporary image d9edfd46-f870-4b20-a58e-f793ea8baec0 is fetched for user f592ecc313ee400f8eb15bf00189d85c. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:22:22 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-623b4f22-9d08-45d2-a589-1bed62d978bd tempest-VolumeDependencyTests-1333096594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307 1G" returned: 0 in 0.402s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-623b4f22-9d08-45d2-a589-1bed62d978bd tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7de526d7-3acb-4b69-a2eb-f06819176e6d -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:22 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7de526d7-3acb-4b69-a2eb-f06819176e6d -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307 Sep 28 16:22:22 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:22 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dad3b26-14f3-4dc1-ab54-d10ad4d2a3fa]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:22 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD Sep 28 16:22:22 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:22 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-623b4f22-9d08-45d2-a589-1bed62d978bd tempest-VolumeDependencyTests-1333096594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7de526d7-3acb-4b69-a2eb-f06819176e6d -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307" returned: 0 in 0.312s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:22 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-623b4f22-9d08-45d2-a589-1bed62d978bd tempest-VolumeDependencyTests-1333096594 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307 is being set with open permissions: ugo+rw Sep 28 16:22:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-623b4f22-9d08-45d2-a589-1bed62d978bd tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:22 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307 Sep 28 16:22:22 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:23 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:23 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD Sep 28 16:22:23 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:23 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-623b4f22-9d08-45d2-a589-1bed62d978bd tempest-VolumeDependencyTests-1333096594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307" returned: 0 in 0.314s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-623b4f22-9d08-45d2-a589-1bed62d978bd tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:23 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.info Sep 28 16:22:23 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:23 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD" returned: 1 in 0.395s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:23 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-623b4f22-9d08-45d2-a589-1bed62d978bd tempest-VolumeDependencyTests-1333096594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.info" returned: 0 in 0.285s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:23 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-623b4f22-9d08-45d2-a589-1bed62d978bd tempest-VolumeDependencyTests-1333096594 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.info is being set with open permissions: ugo+rw Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-623b4f22-9d08-45d2-a589-1bed62d978bd tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:23 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.info Sep 28 16:22:23 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:23 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-623b4f22-9d08-45d2-a589-1bed62d978bd tempest-VolumeDependencyTests-1333096594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.info" returned: 0 in 0.263s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-623b4f22-9d08-45d2-a589-1bed62d978bd tempest-VolumeDependencyTests-1333096594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.399s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1014029383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e372d3c5-6cd2-47b4-90b3-274b2b0177a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66427aed5962406fa73be45c456c6172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:18Z,use_quota=True,user_id='110faecf467d4b0890e1eb4180d9cb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Creating volume e372d3c5-6cd2-47b4-90b3-274b2b0177a9 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:23 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e372d3c5-6cd2-47b4-90b3-274b2b0177a9 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:23 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e372d3c5-6cd2-47b4-90b3-274b2b0177a9 1073741824 Sep 28 16:22:23 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:23 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-623b4f22-9d08-45d2-a589-1bed62d978bd tempest-VolumeDependencyTests-1333096594 None] Create snapshot completed successfully Sep 28 16:22:24 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e372d3c5-6cd2-47b4-90b3-274b2b0177a9 1073741824" returned: 0 in 0.455s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e372d3c5-6cd2-47b4-90b3-274b2b0177a9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:24 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e372d3c5-6cd2-47b4-90b3-274b2b0177a9 Sep 28 16:22:24 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:24 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e372d3c5-6cd2-47b4-90b3-274b2b0177a9" returned: 0 in 0.268s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.842s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-395882931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16551d4-ddb8-40e5-8b3d-d7cc402f65f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66427aed5962406fa73be45c456c6172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:19Z,use_quota=True,user_id='110faecf467d4b0890e1eb4180d9cb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Creating volume b16551d4-ddb8-40e5-8b3d-d7cc402f65f7 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:24 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:24 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7 1073741824 Sep 28 16:22:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bc5885-f446-4c9e-8db7-64dc769f21cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e372d3c5-6cd2-47b4-90b3-274b2b0177a9', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:24 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (008c32bb-1aa7-432e-9f16-193755788614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:24 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Volume volume-e372d3c5-6cd2-47b4-90b3-274b2b0177a9 (e372d3c5-6cd2-47b4-90b3-274b2b0177a9): created successfully Sep 28 16:22:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (008c32bb-1aa7-432e-9f16-193755788614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Flow 'volume_create_manager' (e8ea7036-f959-46c3-8dce-d21160ddc8d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-097b8c10-f1dd-4c42-948d-791ca88cb928 tempest-CreateVolumesFromImageTest-976554443 None] Created volume successfully. Sep 28 16:22:25 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7 1073741824" returned: 0 in 0.590s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Flow 'volume_create_manager' (f42b572e-72f8-4793-8441-da6db0c8e80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97e6444-699b-4d0d-8dfd-49b880ea19fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97e6444-699b-4d0d-8dfd-49b880ea19fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1300021633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e90855b8-7d1b-4412-b054-94bd92468e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ed438196fc4cd7802b103e77c8fb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=feb2801b-b121-4959-87b8-bfce9afe9307,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:25Z,use_quota=True,user_id='6a149d2d30cb412ba186bdbfce6519c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f805b12-efa9-4468-8e56-95842eab4646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f805b12-efa9-4468-8e56-95842eab4646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8caff15-6cdb-46c5-9d52-b4faf24aeae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8caff15-6cdb-46c5-9d52-b4faf24aeae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e90855b8-7d1b-4412-b054-94bd92468e35', 'volume_name': 'volume-e90855b8-7d1b-4412-b054-94bd92468e35', 'volume_size': 1, 'snapshot_id': 'feb2801b-b121-4959-87b8-bfce9afe9307'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b77466e-21d7-4b2d-aae4-8bcdb66aeda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b77466e-21d7-4b2d-aae4-8bcdb66aeda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6cf3ec-01bc-4233-b4c3-b49043763381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:25 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Volume e90855b8-7d1b-4412-b054-94bd92468e35: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e90855b8-7d1b-4412-b054-94bd92468e35', 'volume_size': 1, 'snapshot_id': 'feb2801b-b121-4959-87b8-bfce9afe9307'} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:25 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7 Sep 28 16:22:25 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:25 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7" returned: 0 in 0.299s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.063s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1393897060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2646bf5f-c859-4581-9c37-74ae7a3be3d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdde0572603e4167a21943ba996faade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:19Z,use_quota=True,user_id='875c51545e54451bb1f6c224b46b9f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Creating volume 2646bf5f-c859-4581-9c37-74ae7a3be3d5 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:25 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2646bf5f-c859-4581-9c37-74ae7a3be3d5 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9f1e69-bd0f-4a33-aef4-b8afc5b8e6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:25 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2646bf5f-c859-4581-9c37-74ae7a3be3d5 1073741824 Sep 28 16:22:25 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5511444-dbf8-4337-a9f7-9dbb97df67e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:25 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Volume volume-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7 (b16551d4-ddb8-40e5-8b3d-d7cc402f65f7): created successfully Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5511444-dbf8-4337-a9f7-9dbb97df67e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Flow 'volume_create_manager' (7874d46d-5ad4-4ff8-9257-dc7b283795c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:25 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e916b2c8-93a1-46c9-a096-37ada07db655 tempest-CreateVolumesFromImageTest-976554443 None] Created volume successfully. Sep 28 16:22:26 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2646bf5f-c859-4581-9c37-74ae7a3be3d5 1073741824" returned: 0 in 0.515s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2646bf5f-c859-4581-9c37-74ae7a3be3d5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:26 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2646bf5f-c859-4581-9c37-74ae7a3be3d5 Sep 28 16:22:26 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:26 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "cinder-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2646bf5f-c859-4581-9c37-74ae7a3be3d5" returned: 0 in 0.293s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.378s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2048701945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ca1813-2657-4da0-892c-cad93ee4c5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdde0572603e4167a21943ba996faade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:20Z,use_quota=True,user_id='875c51545e54451bb1f6c224b46b9f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Creating volume c3ca1813-2657-4da0-892c-cad93ee4c5c2 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:26 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c3ca1813-2657-4da0-892c-cad93ee4c5c2 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:26 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c3ca1813-2657-4da0-892c-cad93ee4c5c2 1073741824 Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5641de3-ada4-4072-a157-02671aa81777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2646bf5f-c859-4581-9c37-74ae7a3be3d5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:26 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70707c91-9ca3-47f8-a8b0-dd5a8558f442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:26 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Volume volume-2646bf5f-c859-4581-9c37-74ae7a3be3d5 (2646bf5f-c859-4581-9c37-74ae7a3be3d5): created successfully Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70707c91-9ca3-47f8-a8b0-dd5a8558f442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Flow 'volume_create_manager' (d7e5da29-aad2-4b71-adb1-1daf154af8c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "cinder-quobyte-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f51d6189-141e-4c50-bcdf-5646e2b9e9db tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Created volume successfully. Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-quobyte-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[864b55f3-a5e3-4816-90e8-2bfd1e949b5a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:26 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7 Sep 28 16:22:26 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:27 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c3ca1813-2657-4da0-892c-cad93ee4c5c2 1073741824" returned: 0 in 0.539s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c3ca1813-2657-4da0-892c-cad93ee4c5c2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:27 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c3ca1813-2657-4da0-892c-cad93ee4c5c2 Sep 28 16:22:27 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:27 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7" returned: 0 in 0.460s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:27 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7 Sep 28 16:22:27 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:27 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c3ca1813-2657-4da0-892c-cad93ee4c5c2" returned: 0 in 0.287s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.700s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-494669502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91bf561a-a836-4323-9156-f04909fe2d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdde0572603e4167a21943ba996faade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:21Z,use_quota=True,user_id='875c51545e54451bb1f6c224b46b9f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Creating volume 91bf561a-a836-4323-9156-f04909fe2d74 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:27 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91bf561a-a836-4323-9156-f04909fe2d74 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:27 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37b608f-5ca5-47cf-b3bb-c02c48794f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3ca1813-2657-4da0-892c-cad93ee4c5c2', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56392ed4-b71c-4c9c-bb30-d61565961cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:27 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91bf561a-a836-4323-9156-f04909fe2d74 1073741824 Sep 28 16:22:27 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7" returned: 0 in 0.293s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-quobyte-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7" released by "delete_volume" :: held 0.809s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:27 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Volume volume-c3ca1813-2657-4da0-892c-cad93ee4c5c2 (c3ca1813-2657-4da0-892c-cad93ee4c5c2): created successfully Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56392ed4-b71c-4c9c-bb30-d61565961cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Flow 'volume_create_manager' (c24fcae3-f36e-4dbe-971a-7f971297ca9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8b269a88-5d35-43bb-b73e-c2022f42aacf tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Created volume successfully. Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] Created reservations ['af869418-3974-45a4-ae2c-6c51bf807dbd', 'b57f2006-a95b-4641-9af4-a5282342e31f', 'aa380b5d-1188-452f-86d8-bb90b4004751', 'eed827d3-0336-4c4e-b8a6-64329687e9b0'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:27 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:22:27 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "cinder-e372d3c5-6cd2-47b4-90b3-274b2b0177a9-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-e372d3c5-6cd2-47b4-90b3-274b2b0177a9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "cinder-quobyte-e372d3c5-6cd2-47b4-90b3-274b2b0177a9" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-quobyte-e372d3c5-6cd2-47b4-90b3-274b2b0177a9" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbec9f75-c472-4825-8e15-9f5db60f84c3]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e372d3c5-6cd2-47b4-90b3-274b2b0177a9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:28 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e372d3c5-6cd2-47b4-90b3-274b2b0177a9 Sep 28 16:22:28 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:28 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91bf561a-a836-4323-9156-f04909fe2d74 1073741824" returned: 0 in 0.601s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:28 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.422s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:28 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] Deleted volume successfully. Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91bf561a-a836-4323-9156-f04909fe2d74 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-daa7ee33-d234-468d-b549-987f89fc76d4 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-b16551d4-ddb8-40e5-8b3d-d7cc402f65f7-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:28 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91bf561a-a836-4323-9156-f04909fe2d74 Sep 28 16:22:28 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:28 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e372d3c5-6cd2-47b4-90b3-274b2b0177a9" returned: 0 in 0.533s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e372d3c5-6cd2-47b4-90b3-274b2b0177a9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:28 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e372d3c5-6cd2-47b4-90b3-274b2b0177a9 Sep 28 16:22:28 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:28 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91bf561a-a836-4323-9156-f04909fe2d74" returned: 0 in 0.330s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.048s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1336768091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e515f349-9a85-4064-bfeb-c2eb087aa523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdde0572603e4167a21943ba996faade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:21Z,use_quota=True,user_id='875c51545e54451bb1f6c224b46b9f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Creating volume e515f349-9a85-4064-bfeb-c2eb087aa523 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:28 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e515f349-9a85-4064-bfeb-c2eb087aa523 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2de2bb-e1f4-4c9a-bd51-59fcad670673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91bf561a-a836-4323-9156-f04909fe2d74', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48647127-4758-4080-a138-71949b4d5e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:28 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e515f349-9a85-4064-bfeb-c2eb087aa523 1073741824 Sep 28 16:22:28 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:28 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Volume volume-91bf561a-a836-4323-9156-f04909fe2d74 (91bf561a-a836-4323-9156-f04909fe2d74): created successfully Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48647127-4758-4080-a138-71949b4d5e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Flow 'volume_create_manager' (69424776-fcdd-4408-a287-1312c87759d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:28 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f046a509-9b75-4353-9b86-1d6f8ba2dac4 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Created volume successfully. Sep 28 16:22:28 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e372d3c5-6cd2-47b4-90b3-274b2b0177a9" returned: 0 in 0.313s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-quobyte-e372d3c5-6cd2-47b4-90b3-274b2b0177a9" released by "delete_volume" :: held 0.903s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] Created reservations ['51729246-a3a9-4041-adbb-b259acf3ae67', '748269f6-4330-4c09-97f4-503dc8c7efe6', 'bbfe0724-9085-4813-9f17-fe5335b23146', 'c70bd9d0-d07b-4ef2-8457-45ffe682610f'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:28 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:22:28 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:29 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e515f349-9a85-4064-bfeb-c2eb087aa523 1073741824" returned: 0 in 0.598s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e515f349-9a85-4064-bfeb-c2eb087aa523 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:29 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e515f349-9a85-4064-bfeb-c2eb087aa523 Sep 28 16:22:29 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:29 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.329s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] Deleted volume successfully. Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c6aaec59-e6ac-43cb-ab59-f207f0d66534 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-e372d3c5-6cd2-47b4-90b3-274b2b0177a9-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:29 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e515f349-9a85-4064-bfeb-c2eb087aa523" returned: 0 in 0.292s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.797s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-692936870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a24128-2cd7-44b8-a7e7-f596b6a84cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdde0572603e4167a21943ba996faade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:21Z,use_quota=True,user_id='875c51545e54451bb1f6c224b46b9f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Creating volume a2a24128-2cd7-44b8-a7e7-f596b6a84cf5 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:29 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff840ee4-c7ce-497c-9bb6-3f3f2016e7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e515f349-9a85-4064-bfeb-c2eb087aa523', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848f0083-abb7-498f-b8c8-967e2c2ad518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:29 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5 1073741824 Sep 28 16:22:29 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:29 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Volume volume-e515f349-9a85-4064-bfeb-c2eb087aa523 (e515f349-9a85-4064-bfeb-c2eb087aa523): created successfully Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848f0083-abb7-498f-b8c8-967e2c2ad518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Flow 'volume_create_manager' (7c6dbd6c-3f07-4dad-b566-a6dc4eda6282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-96cefbb5-84af-4798-bf87-3f0a4b4007da tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Created volume successfully. Sep 28 16:22:29 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5 1073741824" returned: 0 in 0.455s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:29 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5 Sep 28 16:22:29 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "cinder-16034720-04f7-4cff-8642-fdfe281567dc-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-16034720-04f7-4cff-8642-fdfe281567dc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "cinder-quobyte-16034720-04f7-4cff-8642-fdfe281567dc" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-quobyte-16034720-04f7-4cff-8642-fdfe281567dc" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0caeee5e-b273-49d9-8918-9486b995609d]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-16034720-04f7-4cff-8642-fdfe281567dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:30 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5" returned: 0 in 0.321s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.850s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329a5def-ebb6-4274-973a-a05b8baaa3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8614d0bff70045a4a11c0bbad9aaac87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:21Z,use_quota=True,user_id='f592ecc313ee400f8eb15bf00189d85c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51adc011-e78d-439a-8fff-7fb4344270b7),volume_type_id=51adc011-e78d-439a-8fff-7fb4344270b7)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Creating volume 329a5def-ebb6-4274-973a-a05b8baaa3d8 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:30 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-329a5def-ebb6-4274-973a-a05b8baaa3d8 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c3ce8f-7b0b-4d50-972a-d282e4f111c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:30 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-329a5def-ebb6-4274-973a-a05b8baaa3d8 1073741824 Sep 28 16:22:30 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d91399-9023-41d6-bd1d-0c3493689dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:30 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-16034720-04f7-4cff-8642-fdfe281567dc Sep 28 16:22:30 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:30 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Volume volume-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5 (a2a24128-2cd7-44b8-a7e7-f596b6a84cf5): created successfully Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d91399-9023-41d6-bd1d-0c3493689dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Flow 'volume_create_manager' (509b975d-0e45-4aa9-837d-faa6c0009459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-05447fe0-92c6-46ef-a6ba-a48e8de64909 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Created volume successfully. Sep 28 16:22:30 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-16034720-04f7-4cff-8642-fdfe281567dc" returned: 0 in 0.459s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-16034720-04f7-4cff-8642-fdfe281567dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:30 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-16034720-04f7-4cff-8642-fdfe281567dc Sep 28 16:22:30 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:30 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-329a5def-ebb6-4274-973a-a05b8baaa3d8 1073741824" returned: 0 in 0.515s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-329a5def-ebb6-4274-973a-a05b8baaa3d8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:30 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-329a5def-ebb6-4274-973a-a05b8baaa3d8 Sep 28 16:22:30 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:30 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-16034720-04f7-4cff-8642-fdfe281567dc" returned: 0 in 0.321s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-quobyte-16034720-04f7-4cff-8642-fdfe281567dc" released by "delete_volume" :: held 0.837s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] Created reservations ['240c91b2-71c9-4876-af2f-ea3edaee9930', 'b4c048f6-44e2-440f-a636-9ab0aad30b88', 'cffcf6fc-cd5b-4578-8893-1e8dee5521d0', '04502713-4c7c-4486-86e3-691db43b62f4'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:31 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:22:31 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:31 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-329a5def-ebb6-4274-973a-a05b8baaa3d8" returned: 0 in 0.351s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.777s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Acquiring lock "cinder-quobyte-feb2801b-b121-4959-87b8-bfce9afe9307-e90855b8-7d1b-4412-b054-94bd92468e35" by "_create_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Lock "cinder-quobyte-feb2801b-b121-4959-87b8-bfce9afe9307-e90855b8-7d1b-4412-b054-94bd92468e35" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Creating volume e90855b8-7d1b-4412-b054-94bd92468e35 from snapshot feb2801b-b121-4959-87b8-bfce9afe9307 {{(pid=87087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Acquiring lock "cinder-quobyte-e90855b8-7d1b-4412-b054-94bd92468e35" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Attempting download of d9edfd46-f870-4b20-a58e-f793ea8baec0 ((None, [{'url': 'file:///opt/stack/data/glance/images/d9edfd46-f870-4b20-a58e-f793ea8baec0', 'metadata': {}}])) to volume 329a5def-ebb6-4274-973a-a05b8baaa3d8. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "cinder-d4121c64-282a-435d-95ed-a657c9f6789d-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Lock "cinder-quobyte-e90855b8-7d1b-4412-b054-94bd92468e35" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] snapshot: feb2801b-b121-4959-87b8-bfce9afe9307, volume: e90855b8-7d1b-4412-b054-94bd92468e35, {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-d4121c64-282a-435d-95ed-a657c9f6789d-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca2a2a8-f8e2-4c81-bfc5-2f7121d025ec]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[897736ae-64ff-4f9d-b9d8-c7b4ef39b96b]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d9edfd46-f870-4b20-a58e-f793ea8baec0_e_m7boa3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "cinder-quobyte-d4121c64-282a-435d-95ed-a657c9f6789d" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-quobyte-d4121c64-282a-435d-95ed-a657c9f6789d" acquired by "delete_volume" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11e36cd-c286-4984-954a-17bf796f3f50]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d4121c64-282a-435d-95ed-a657c9f6789d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "cinder-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:31 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.500s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:31 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307 Sep 28 16:22:31 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:31 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] Deleted volume successfully. Sep 28 16:22:31 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d9edfd46-f870-4b20-a58e-f793ea8baec0_e_m7boa3 Sep 28 16:22:31 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b407131-6162-492e-9a00-baecfb5751b6 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-16034720-04f7-4cff-8642-fdfe281567dc-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "cinder-quobyte-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-quobyte-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:31 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d4121c64-282a-435d-95ed-a657c9f6789d Sep 28 16:22:31 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1fbb76-2a5d-4aed-8809-58077affa74a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:31 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5 Sep 28 16:22:31 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:32 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307" returned: 0 in 0.648s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7de526d7-3acb-4b69-a2eb-f06819176e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bb0248-96e4-43e0-9c8b-fc9d7b6a1806]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:32 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d9edfd46-f870-4b20-a58e-f793ea8baec0_e_m7boa3" returned: 0 in 0.663s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d9edfd46-f870-4b20-a58e-f793ea8baec0_e_m7boa3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:32 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d4121c64-282a-435d-95ed-a657c9f6789d" returned: 0 in 0.634s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d4121c64-282a-435d-95ed-a657c9f6789d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:32 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d4121c64-282a-435d-95ed-a657c9f6789d Sep 28 16:22:32 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:32 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d Sep 28 16:22:32 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:32 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d9edfd46-f870-4b20-a58e-f793ea8baec0_e_m7boa3 Sep 28 16:22:32 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:32 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5" returned: 0 in 0.531s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:32 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5 Sep 28 16:22:32 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:32 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d4121c64-282a-435d-95ed-a657c9f6789d" returned: 0 in 0.351s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:32 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:32 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-quobyte-d4121c64-282a-435d-95ed-a657c9f6789d" released by "delete_volume" :: held 1.064s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d9edfd46-f870-4b20-a58e-f793ea8baec0_e_m7boa3" returned: 1 in 0.465s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d9edfd46-f870-4b20-a58e-f793ea8baec0_e_m7boa3' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d" returned: 0 in 0.498s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Path /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e90855b8-7d1b-4412-b054-94bd92468e35 not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e90855b8-7d1b-4412-b054-94bd92468e35 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[617d6394-7536-4e53-98ea-7da9c68eee28]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:32 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e90855b8-7d1b-4412-b054-94bd92468e35 Sep 28 16:22:32 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:32 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5" returned: 0 in 0.327s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-quobyte-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5" released by "delete_volume" :: held 0.928s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] Created reservations ['ce56d213-da5c-4afa-a509-ecc00195cc35', '4103cfee-6bdd-454b-bdae-66aa6896708d', 'c2d2ab2a-2a97-487b-b69e-6d24d05908df', '04ad63fb-3d00-4bc6-92d4-189a8cd4ca8e'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:32 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD Sep 28 16:22:32 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Created reservations ['88e9776d-9c15-407e-a6d9-7b5821ba5a05', 'acb5c69e-9833-488e-a127-7aa0e5d6f8f7', 'd0395fb8-790a-4494-8fd6-bd6966c4f878', '01b2a359-85ef-4148-92ab-40f313eadf76'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:32 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:22:32 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:33 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:22:33 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:33 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:33 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD Sep 28 16:22:33 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:33 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.433s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:33 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] Deleted volume successfully. Sep 28 16:22:33 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.407s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:33 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Deleted volume successfully. Sep 28 16:22:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2ac89e3d-3899-432d-8991-bb3f374c8aa9 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-d4121c64-282a-435d-95ed-a657c9f6789d-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-631bc82d-8b0e-44aa-99a9-5ebca493336e tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-a2a24128-2cd7-44b8-a7e7-f596b6a84cf5-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:33 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD" returned: 1 in 0.546s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:22:33 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] d9edfd46-f870-4b20-a58e-f793ea8baec0 was raw, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:22:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-329a5def-ebb6-4274-973a-a05b8baaa3d8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:33 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-329a5def-ebb6-4274-973a-a05b8baaa3d8 Sep 28 16:22:33 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "cinder-498fe0d5-50b1-4df9-a5ca-69b061e6f3af-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-498fe0d5-50b1-4df9-a5ca-69b061e6f3af-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "cinder-quobyte-498fe0d5-50b1-4df9-a5ca-69b061e6f3af" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-quobyte-498fe0d5-50b1-4df9-a5ca-69b061e6f3af" acquired by "delete_volume" :: waited 0.041s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:34 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6d1218-b52f-4b25-a3f0-411501646bb8]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-498fe0d5-50b1-4df9-a5ca-69b061e6f3af {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "cinder-e515f349-9a85-4064-bfeb-c2eb087aa523-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-e515f349-9a85-4064-bfeb-c2eb087aa523-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "cinder-quobyte-e515f349-9a85-4064-bfeb-c2eb087aa523" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-quobyte-e515f349-9a85-4064-bfeb-c2eb087aa523" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:34 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-498fe0d5-50b1-4df9-a5ca-69b061e6f3af Sep 28 16:22:34 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:34 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1561da-35a9-4fcb-8e20-21385213dc1b]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e515f349-9a85-4064-bfeb-c2eb087aa523 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:34 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e515f349-9a85-4064-bfeb-c2eb087aa523 Sep 28 16:22:34 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:34 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:34 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-329a5def-ebb6-4274-973a-a05b8baaa3d8" returned: 0 in 1.238s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:34 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d9edfd46-f870-4b20-a58e-f793ea8baec0_94s1k0rbdevstack@QuobyteHD, size 0.00 MB, duration 1.24 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-329a5def-ebb6-4274-973a-a05b8baaa3d8 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:22:34 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 16:22:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-329a5def-ebb6-4274-973a-a05b8baaa3d8 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-498fe0d5-50b1-4df9-a5ca-69b061e6f3af" returned: 0 in 0.890s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-498fe0d5-50b1-4df9-a5ca-69b061e6f3af {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:34 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-329a5def-ebb6-4274-973a-a05b8baaa3d8 1G Sep 28 16:22:34 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:34 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-498fe0d5-50b1-4df9-a5ca-69b061e6f3af Sep 28 16:22:34 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:35 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:22:35 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:35 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e515f349-9a85-4064-bfeb-c2eb087aa523" returned: 0 in 0.832s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e515f349-9a85-4064-bfeb-c2eb087aa523 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:35 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e515f349-9a85-4064-bfeb-c2eb087aa523 Sep 28 16:22:35 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:35 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-498fe0d5-50b1-4df9-a5ca-69b061e6f3af" returned: 0 in 0.571s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:35 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-quobyte-498fe0d5-50b1-4df9-a5ca-69b061e6f3af" released by "delete_volume" :: held 1.578s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.482s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] Created reservations ['ce1172b9-cb8a-4dda-99a8-d3fcbb44f9c3', 'aefc82a3-dffd-40ff-a78e-59bcc143d193', '72711191-4ffe-47e8-87b1-12c1a6e076c5', 'c6a5e277-0be1-4cb2-ab4e-a35e9b29c5ec'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:35 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-329a5def-ebb6-4274-973a-a05b8baaa3d8 1G" returned: 0 in 0.867s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Downloaded image d9edfd46-f870-4b20-a58e-f793ea8baec0 ((None, [{'url': 'file:///opt/stack/data/glance/images/d9edfd46-f870-4b20-a58e-f793ea8baec0', 'metadata': {}}])) to volume 329a5def-ebb6-4274-973a-a05b8baaa3d8 successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Temporary image d9edfd46-f870-4b20-a58e-f793ea8baec0 for user f592ecc313ee400f8eb15bf00189d85c is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Marking volume 329a5def-ebb6-4274-973a-a05b8baaa3d8 as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:22:35 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Copying metadata from image d9edfd46-f870-4b20-a58e-f793ea8baec0 to 329a5def-ebb6-4274-973a-a05b8baaa3d8. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Creating volume glance metadata for volume 329a5def-ebb6-4274-973a-a05b8baaa3d8 backed by image d9edfd46-f870-4b20-a58e-f793ea8baec0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd9edfd46-f870-4b20-a58e-f793ea8baec0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8f365f724ef7f661560a3f6f03b20b6b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e515f349-9a85-4064-bfeb-c2eb087aa523" returned: 0 in 0.700s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-quobyte-e515f349-9a85-4064-bfeb-c2eb087aa523" released by "delete_volume" :: held 1.694s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:35 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:22:35 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7027674-c80d-4268-9458-ac9ca44be941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-329a5def-ebb6-4274-973a-a05b8baaa3d8', 'volume_size': 1, 'image_id': 'd9edfd46-f870-4b20-a58e-f793ea8baec0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d9edfd46-f870-4b20-a58e-f793ea8baec0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f365f724ef7f661560a3f6f03b20b6b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8614d0bff70045a4a11c0bbad9aaac87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1c9353e46987f6b0279bb97b372a98223b12cb1b72ec728259d6453eb48607533689ff47a3fdd98acb54ad9041ab378d401b96119bda4f7df26a7466b1404659', 'id': 'd9edfd46-f870-4b20-a58e-f793ea8baec0', 'created_at': datetime.datetime(2026, 9, 28, 14, 22, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 22, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d9edfd46-f870-4b20-a58e-f793ea8baec0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126e5c98-205f-457f-94aa-df0782b20b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Created reservations ['17fd730b-fa6f-42a6-a593-7e3a78330369', '2ed19d73-fea8-4519-91ec-f20de34f2c84', '53eb51ee-7e33-46ed-be64-3ae893ed32c0', 'b464fa0f-c8ec-47ff-bdc9-1a9aef360505'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:36 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Volume volume-329a5def-ebb6-4274-973a-a05b8baaa3d8 (329a5def-ebb6-4274-973a-a05b8baaa3d8): created successfully Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126e5c98-205f-457f-94aa-df0782b20b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Flow 'volume_create_manager' (c0f9b9c5-8918-4778-9ef2-184d65b47d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1a5af37e-7f2e-44a9-8146-662866c13b48 tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Created volume successfully. Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:36 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:22:36 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:36 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.690s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] Deleted volume successfully. Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9a270793-fac1-40a7-ac70-d2fc578bc732 tempest-CreateVolumesFromImageTest-976554443 None] Lock "cinder-498fe0d5-50b1-4df9-a5ca-69b061e6f3af-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "cinder-91bf561a-a836-4323-9156-f04909fe2d74-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:36 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.530s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-91bf561a-a836-4323-9156-f04909fe2d74-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Deleted volume successfully. Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8a689581-d431-459c-b428-67091cd4fa18 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-e515f349-9a85-4064-bfeb-c2eb087aa523-delete_volume" released by "delete_volume" :: held 2.845s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "cinder-quobyte-91bf561a-a836-4323-9156-f04909fe2d74" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-quobyte-91bf561a-a836-4323-9156-f04909fe2d74" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb51dde-b12b-41c6-83a7-ca9feefc731a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91bf561a-a836-4323-9156-f04909fe2d74 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Acquiring lock "cinder-329a5def-ebb6-4274-973a-a05b8baaa3d8-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Lock "cinder-329a5def-ebb6-4274-973a-a05b8baaa3d8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Acquiring lock "cinder-quobyte-329a5def-ebb6-4274-973a-a05b8baaa3d8" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Lock "cinder-quobyte-329a5def-ebb6-4274-973a-a05b8baaa3d8" acquired by "delete_volume" :: waited 0.035s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:37 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91bf561a-a836-4323-9156-f04909fe2d74 Sep 28 16:22:37 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68ec79c-165f-4168-b650-a9f93d62c3ec]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-329a5def-ebb6-4274-973a-a05b8baaa3d8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:37 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-329a5def-ebb6-4274-973a-a05b8baaa3d8 Sep 28 16:22:37 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:37 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91bf561a-a836-4323-9156-f04909fe2d74" returned: 0 in 0.926s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91bf561a-a836-4323-9156-f04909fe2d74 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:38 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91bf561a-a836-4323-9156-f04909fe2d74 Sep 28 16:22:38 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:38 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-329a5def-ebb6-4274-973a-a05b8baaa3d8" returned: 0 in 0.983s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-329a5def-ebb6-4274-973a-a05b8baaa3d8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:38 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-329a5def-ebb6-4274-973a-a05b8baaa3d8 Sep 28 16:22:38 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:38 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-91bf561a-a836-4323-9156-f04909fe2d74" returned: 0 in 0.550s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-quobyte-91bf561a-a836-4323-9156-f04909fe2d74" released by "delete_volume" :: held 1.589s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:38 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Created reservations ['11e86aad-e57d-4189-b1d5-63e7c331afa2', '118ae7d3-59f1-4671-ad51-89bd5fce26b2', 'a9aee259-ef6b-474e-878f-e5dec5f1fd5c', 'fe1c0add-ce4a-41bd-9fcc-c31d49e5fa8d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:38 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:22:38 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:39 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-329a5def-ebb6-4274-973a-a05b8baaa3d8" returned: 0 in 0.671s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Lock "cinder-quobyte-329a5def-ebb6-4274-973a-a05b8baaa3d8" released by "delete_volume" :: held 1.774s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "cinder-c3ca1813-2657-4da0-892c-cad93ee4c5c2-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:39 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Created reservations ['dd46a265-0137-4420-8b4d-4bdfc7409235', '1390a550-9f72-4d34-8025-a4e72c52ce57', 'fc95d900-a25b-43e6-90d0-dcb859fe27dd', '37fa58c5-80cb-4a4c-b960-14be4a6bc08a'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-c3ca1813-2657-4da0-892c-cad93ee4c5c2-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "cinder-quobyte-c3ca1813-2657-4da0-892c-cad93ee4c5c2" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:39 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.889s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:39 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-quobyte-c3ca1813-2657-4da0-892c-cad93ee4c5c2" acquired by "delete_volume" :: waited 0.142s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:39 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:22:39 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Deleted volume successfully. Sep 28 16:22:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c9671de1-c5cb-43ef-9b0a-33ffcaaae41b tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-91bf561a-a836-4323-9156-f04909fe2d74-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:39 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1a5178-7974-40e1-9365-5ea6b85220b2]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c3ca1813-2657-4da0-892c-cad93ee4c5c2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:40 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c3ca1813-2657-4da0-892c-cad93ee4c5c2 Sep 28 16:22:40 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:40 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.707s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:40 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:40 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Deleted volume successfully. Sep 28 16:22:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef467620-ff04-4a62-a4af-b2d88e814d4d tempest-VolumeAndVolumeTypeFromImageTest-992881193 None] Lock "cinder-329a5def-ebb6-4274-973a-a05b8baaa3d8-delete_volume" released by "delete_volume" :: held 3.298s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:40 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c3ca1813-2657-4da0-892c-cad93ee4c5c2" returned: 0 in 0.763s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c3ca1813-2657-4da0-892c-cad93ee4c5c2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:40 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c3ca1813-2657-4da0-892c-cad93ee4c5c2 Sep 28 16:22:40 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:41 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c3ca1813-2657-4da0-892c-cad93ee4c5c2" returned: 0 in 0.680s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-quobyte-c3ca1813-2657-4da0-892c-cad93ee4c5c2" released by "delete_volume" :: held 1.591s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:41 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Created reservations ['f080c472-7b55-4868-91f9-94cc1496193b', '55374785-d334-4580-8d77-bc9136ef785f', '425409ac-c214-4b4d-9875-e0ccd6512bfd', '204d22b7-9214-4182-babe-81e3ecc812e5'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:41 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:22:41 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "cinder-2646bf5f-c859-4581-9c37-74ae7a3be3d5-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-2646bf5f-c859-4581-9c37-74ae7a3be3d5-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "cinder-quobyte-2646bf5f-c859-4581-9c37-74ae7a3be3d5" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:42 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-quobyte-2646bf5f-c859-4581-9c37-74ae7a3be3d5" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e90855b8-7d1b-4412-b054-94bd92468e35" returned: 0 in 9.625s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d, size 1024.00 MB, duration 9.63 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e90855b8-7d1b-4412-b054-94bd92468e35 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:22:42 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Converted 1024.00 MB image at 106.37 MB/s Sep 28 16:22:42 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e90855b8-7d1b-4412-b054-94bd92468e35 is being set with open permissions: ugo+rw Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e90855b8-7d1b-4412-b054-94bd92468e35 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:42 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.560s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35826c5-3e75-4d4e-9dc2-84a128eba23a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2646bf5f-c859-4581-9c37-74ae7a3be3d5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:42 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e90855b8-7d1b-4412-b054-94bd92468e35 Sep 28 16:22:42 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Deleted volume successfully. Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6bbf9eb2-df48-46a1-9902-2fb7a712ee8d tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-c3ca1813-2657-4da0-892c-cad93ee4c5c2-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:42 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2646bf5f-c859-4581-9c37-74ae7a3be3d5 Sep 28 16:22:42 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:42 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e90855b8-7d1b-4412-b054-94bd92468e35" returned: 0 in 0.332s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Lock "cinder-quobyte-e90855b8-7d1b-4412-b054-94bd92468e35" released by "_copy_volume_from_snapshot" :: held 11.287s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Lock "cinder-quobyte-feb2801b-b121-4959-87b8-bfce9afe9307-e90855b8-7d1b-4412-b054-94bd92468e35" released by "_create_volume_from_snapshot" :: held 11.388s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.424s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6cf3ec-01bc-4233-b4c3-b49043763381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e90855b8-7d1b-4412-b054-94bd92468e35', 'volume_size': 1, 'snapshot_id': 'feb2801b-b121-4959-87b8-bfce9afe9307'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a5d6e0-0095-4718-836a-da739b5feca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:42 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Volume volume-e90855b8-7d1b-4412-b054-94bd92468e35 (e90855b8-7d1b-4412-b054-94bd92468e35): created successfully Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a5d6e0-0095-4718-836a-da739b5feca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Flow 'volume_create_manager' (f42b572e-72f8-4793-8441-da6db0c8e80b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c4a4de72-f84d-4c41-85de-d6ad55db56c4 tempest-VolumeDependencyTests-1333096594 None] Created volume successfully. Sep 28 16:22:42 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2646bf5f-c859-4581-9c37-74ae7a3be3d5" returned: 0 in 0.554s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2646bf5f-c859-4581-9c37-74ae7a3be3d5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:42 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2646bf5f-c859-4581-9c37-74ae7a3be3d5 Sep 28 16:22:42 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:43 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-2646bf5f-c859-4581-9c37-74ae7a3be3d5" returned: 0 in 0.288s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-quobyte-2646bf5f-c859-4581-9c37-74ae7a3be3d5" released by "delete_volume" :: held 0.917s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] Acquiring lock "cinder-feb2801b-b121-4959-87b8-bfce9afe9307-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] Lock "cinder-feb2801b-b121-4959-87b8-bfce9afe9307-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] Acquiring lock "cinder-quobyte-7de526d7-3acb-4b69-a2eb-f06819176e6d" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] Lock "cinder-quobyte-7de526d7-3acb-4b69-a2eb-f06819176e6d" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] Acquiring lock "cinder-quobyte-feb2801b-b121-4959-87b8-bfce9afe9307" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Created reservations ['c82c294c-1e17-49d7-bb87-2c8ea521a526', '522aabe9-360a-4f0f-85bf-993ef784796f', 'a1519a5c-ad26-4465-bfaa-cc2c01a7a54b', '7b7b21fc-bacf-4397-8392-5ee3268f0492'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] Lock "cinder-quobyte-feb2801b-b121-4959-87b8-bfce9afe9307" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] Deleting offline snapshot feb2801b-b121-4959-87b8-bfce9afe9307 of volume 7de526d7-3acb-4b69-a2eb-f06819176e6d {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] snapshot_file for this snap is: volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bd06c4-3f84-4a4c-9e4e-749cd138e2c4]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:43 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307 Sep 28 16:22:43 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:43 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:22:43 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:43 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.365s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:43 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:43 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Deleted volume successfully. Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307" returned: 0 in 0.519s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7de526d7-3acb-4b69-a2eb-f06819176e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0a69f5cb-e3c7-46b8-9691-6afe31c1f235 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-2646bf5f-c859-4581-9c37-74ae7a3be3d5-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76ec571-2d1f-419d-81fa-e5b136c7a1e9]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:44 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d Sep 28 16:22:44 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Flow 'volume_create_manager' (a306e8c5-6c7a-47fd-a5b4-a247bed9e12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2686d8-db4f-42de-9c9c-2366d0ed9a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2686d8-db4f-42de-9c9c-2366d0ed9a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-546617856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4df1a9-ffdc-46a6-be25-c971f41c1c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1609af3fd6ee4767b26493db71dd26b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:44Z,use_quota=True,user_id='3acda8724fa147e48edf77b81cdb2e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72d8a58-54b3-482b-8f8b-c94cd546a0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72d8a58-54b3-482b-8f8b-c94cd546a0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a710669-bb32-4190-be53-a5f28d1f31ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a710669-bb32-4190-be53-a5f28d1f31ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f4df1a9-ffdc-46a6-be25-c971f41c1c6e', 'volume_name': 'volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c15684-a4a0-445f-b7b6-a2f2ba249b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c15684-a4a0-445f-b7b6-a2f2ba249b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d5eb5b-bfc5-4ac1-b981-2105d67b7bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:44 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Volume 7f4df1a9-ffdc-46a6-be25-c971f41c1c6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e', 'volume_size': 1} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-546617856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4df1a9-ffdc-46a6-be25-c971f41c1c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1609af3fd6ee4767b26493db71dd26b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:44Z,use_quota=True,user_id='3acda8724fa147e48edf77b81cdb2e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Creating volume 7f4df1a9-ffdc-46a6-be25-c971f41c1c6e {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:44 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "cinder-8c827d12-ff6b-4679-9ef6-470d1c8bbef9-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:44 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e 1073741824 Sep 28 16:22:44 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-8c827d12-ff6b-4679-9ef6-470d1c8bbef9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "cinder-quobyte-8c827d12-ff6b-4679-9ef6-470d1c8bbef9" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-quobyte-8c827d12-ff6b-4679-9ef6-470d1c8bbef9" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:44 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d" returned: 0 in 0.711s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[852f571f-3970-4fae-be95-1348308c217d]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c827d12-ff6b-4679-9ef6-470d1c8bbef9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:44 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307 Sep 28 16:22:44 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:44 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c827d12-ff6b-4679-9ef6-470d1c8bbef9 Sep 28 16:22:44 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:45 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e 1073741824" returned: 0 in 0.606s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:45 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307" returned: 0 in 0.533s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:45 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e Sep 28 16:22:45 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:45 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c827d12-ff6b-4679-9ef6-470d1c8bbef9" returned: 0 in 0.554s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c827d12-ff6b-4679-9ef6-470d1c8bbef9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:45 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307 Sep 28 16:22:45 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:45 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c827d12-ff6b-4679-9ef6-470d1c8bbef9 Sep 28 16:22:45 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:45 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e" returned: 0 in 0.354s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d5eb5b-bfc5-4ac1-b981-2105d67b7bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c636a59-d67c-4c73-b743-5bf5a4e76fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:45 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:45 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Volume volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e (7f4df1a9-ffdc-46a6-be25-c971f41c1c6e): created successfully Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c636a59-d67c-4c73-b743-5bf5a4e76fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Flow 'volume_create_manager' (a306e8c5-6c7a-47fd-a5b4-a247bed9e12c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d.feb2801b-b121-4959-87b8-bfce9afe9307" returned: 0 in 0.436s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:45 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:45 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4d3e0ec1-7a24-4a55-be25-4273f4768199 tempest-CreateVolumesFromSnapshotTest-216412147 None] Created volume successfully. Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-8c827d12-ff6b-4679-9ef6-470d1c8bbef9" returned: 0 in 0.449s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] Lock "cinder-quobyte-feb2801b-b121-4959-87b8-bfce9afe9307" released by "_delete_snapshot" :: held 2.383s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-quobyte-8c827d12-ff6b-4679-9ef6-470d1c8bbef9" released by "delete_volume" :: held 1.070s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] Lock "cinder-quobyte-7de526d7-3acb-4b69-a2eb-f06819176e6d" released by "delete_snapshot" :: held 2.427s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Created reservations ['63ae3b9d-a422-4e5f-bb6c-a3265c277a52', '71aa04f5-3617-49f4-9829-7bdb51e4587c', '924d0e31-4334-4cf4-bd9e-3ebbac9cb2d2', 'a1c50fe8-d988-4a8f-99b1-c46a5c6fbd5d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] Created reservations ['de613a55-bbe2-48ad-9ba3-23e4ae8fb949', 'eda1e221-a7e2-40e4-a898-b43efad70444', '3a7838f2-4adb-42ae-ac8d-02f654d03158', '5325f83d-d595-463c-9c3c-2134f3f8833a'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:45 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:22:45 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:45 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] Delete snapshot completed successfully. Sep 28 16:22:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-514a766b-d845-4320-b7fb-666cf7608f5d tempest-VolumeDependencyTests-1333096594 None] Lock "cinder-feb2801b-b121-4959-87b8-bfce9afe9307-delete_snapshot" released by "delete_snapshot" :: held 2.684s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:46 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.286s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:46 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:46 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Deleted volume successfully. Sep 28 16:22:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f374c69f-b661-4919-9ce5-c4e993bfe6e5 tempest-CreateVolumesFromSourceVolumeTest-456614453 None] Lock "cinder-8c827d12-ff6b-4679-9ef6-470d1c8bbef9-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] Acquiring lock "cinder-7de526d7-3acb-4b69-a2eb-f06819176e6d-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] Lock "cinder-7de526d7-3acb-4b69-a2eb-f06819176e6d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] Acquiring lock "cinder-quobyte-7de526d7-3acb-4b69-a2eb-f06819176e6d" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] Lock "cinder-quobyte-7de526d7-3acb-4b69-a2eb-f06819176e6d" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:46 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eb2fe2-0be1-43e3-8558-5b79f9644d4f]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-00492c04-bd8c-4ab0-a8e0-0ffeb38d8285 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-00492c04-bd8c-4ab0-a8e0-0ffeb38d8285 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-00492c04-bd8c-4ab0-a8e0-0ffeb38d8285 tempest-CreateVolumesFromSnapshotTest-216412147 None] Creating offline snapshot d2cb2a62-c8ce-498a-a2c4-a0678d580d38 of volume 7f4df1a9-ffdc-46a6-be25-c971f41c1c6e {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:22:46 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41bf273-c5e5-4970-a085-f9c2bb3abee0]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00492c04-bd8c-4ab0-a8e0-0ffeb38d8285 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:46 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d Sep 28 16:22:46 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:46 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e Sep 28 16:22:46 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:47 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d" returned: 0 in 0.478s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:47 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d Sep 28 16:22:47 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:47 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00492c04-bd8c-4ab0-a8e0-0ffeb38d8285 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e" returned: 0 in 0.521s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00492c04-bd8c-4ab0-a8e0-0ffeb38d8285 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:47 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38 1G Sep 28 16:22:47 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:47 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7de526d7-3acb-4b69-a2eb-f06819176e6d" returned: 0 in 0.350s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] Lock "cinder-quobyte-7de526d7-3acb-4b69-a2eb-f06819176e6d" released by "delete_volume" :: held 0.933s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:47 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] Created reservations ['b47c53e3-ffc9-4381-b814-23b9e1f1efa5', '932d60f0-90e4-411e-8710-680247350130', '3f065002-77fc-4266-8d2f-04b96b443e19', '003d7a3c-0d40-44c3-a2ed-bbb8a4325d38'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:47 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:22:47 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:47 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00492c04-bd8c-4ab0-a8e0-0ffeb38d8285 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38 1G" returned: 0 in 0.653s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00492c04-bd8c-4ab0-a8e0-0ffeb38d8285 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:47 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38 Sep 28 16:22:47 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:48 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Flow 'volume_create_manager' (c80a295e-2b5e-4b0b-8da1-bb0cfee67ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2dc682-8882-4f76-b697-366981e43771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.457s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:48 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] Deleted volume successfully. Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2dc682-8882-4f76-b697-366981e43771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6de1095-eb61-427a-8857-e8ada6cd11dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72cd68a356e4578ac9a0508505b8e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:48Z,use_quota=True,user_id='4a87750ad78f48c9a22641affe447cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7517c9f-be5e-49a3-b15c-ce435023376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7517c9f-be5e-49a3-b15c-ce435023376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150ea39d-8ba1-4832-b11d-fc258f7b2037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150ea39d-8ba1-4832-b11d-fc258f7b2037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6de1095-eb61-427a-8857-e8ada6cd11dc', 'volume_name': 'volume-a6de1095-eb61-427a-8857-e8ada6cd11dc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c50c07-8213-47d0-9401-f5d5aea206bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c50c07-8213-47d0-9401-f5d5aea206bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1307ae7-62e9-4247-acaa-07d86438228b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:48 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Volume a6de1095-eb61-427a-8857-e8ada6cd11dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6de1095-eb61-427a-8857-e8ada6cd11dc', 'volume_size': 1} Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f3a4f038-4835-44c3-b1e3-2addca8434a0 tempest-VolumeDependencyTests-1333096594 None] Lock "cinder-7de526d7-3acb-4b69-a2eb-f06819176e6d-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:48 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00492c04-bd8c-4ab0-a8e0-0ffeb38d8285 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38" returned: 0 in 0.416s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:48 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-00492c04-bd8c-4ab0-a8e0-0ffeb38d8285 tempest-CreateVolumesFromSnapshotTest-216412147 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38 is being set with open permissions: ugo+rw Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00492c04-bd8c-4ab0-a8e0-0ffeb38d8285 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:48 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38 Sep 28 16:22:48 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:48 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00492c04-bd8c-4ab0-a8e0-0ffeb38d8285 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38" returned: 0 in 0.264s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00492c04-bd8c-4ab0-a8e0-0ffeb38d8285 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:48 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.info Sep 28 16:22:48 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] Acquiring lock "cinder-e90855b8-7d1b-4412-b054-94bd92468e35-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] Lock "cinder-e90855b8-7d1b-4412-b054-94bd92468e35-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] Acquiring lock "cinder-quobyte-e90855b8-7d1b-4412-b054-94bd92468e35" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] Lock "cinder-quobyte-e90855b8-7d1b-4412-b054-94bd92468e35" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:48 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00492c04-bd8c-4ab0-a8e0-0ffeb38d8285 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.info" returned: 0 in 0.338s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:48 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-00492c04-bd8c-4ab0-a8e0-0ffeb38d8285 tempest-CreateVolumesFromSnapshotTest-216412147 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.info is being set with open permissions: ugo+rw Sep 28 16:22:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00492c04-bd8c-4ab0-a8e0-0ffeb38d8285 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[179cc4b5-4510-4726-8d25-f6eba3f9912a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e90855b8-7d1b-4412-b054-94bd92468e35 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:49 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.info Sep 28 16:22:49 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:49 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e90855b8-7d1b-4412-b054-94bd92468e35 Sep 28 16:22:49 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:49 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00492c04-bd8c-4ab0-a8e0-0ffeb38d8285 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.info" returned: 0 in 0.313s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-00492c04-bd8c-4ab0-a8e0-0ffeb38d8285 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.635s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.049s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6de1095-eb61-427a-8857-e8ada6cd11dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72cd68a356e4578ac9a0508505b8e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:48Z,use_quota=True,user_id='4a87750ad78f48c9a22641affe447cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Creating volume a6de1095-eb61-427a-8857-e8ada6cd11dc {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:49 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a6de1095-eb61-427a-8857-e8ada6cd11dc 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:49 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a6de1095-eb61-427a-8857-e8ada6cd11dc 1073741824 Sep 28 16:22:49 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-00492c04-bd8c-4ab0-a8e0-0ffeb38d8285 tempest-CreateVolumesFromSnapshotTest-216412147 None] Create snapshot completed successfully Sep 28 16:22:49 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e90855b8-7d1b-4412-b054-94bd92468e35" returned: 0 in 0.466s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e90855b8-7d1b-4412-b054-94bd92468e35 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:49 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e90855b8-7d1b-4412-b054-94bd92468e35 Sep 28 16:22:49 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:49 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e90855b8-7d1b-4412-b054-94bd92468e35" returned: 0 in 0.331s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] Lock "cinder-quobyte-e90855b8-7d1b-4412-b054-94bd92468e35" released by "delete_volume" :: held 0.876s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] Created reservations ['42523ec6-16c0-4ebd-8261-7af9e535e9a7', 'f0a87fa0-b5f4-4edd-aade-28decfb941e8', '2aa453c9-c4f6-4fcd-a449-0bcfc4cabd56', '6a491e98-f21f-4b80-8233-a0c2554f2468'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:49 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a6de1095-eb61-427a-8857-e8ada6cd11dc 1073741824" returned: 0 in 0.618s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a6de1095-eb61-427a-8857-e8ada6cd11dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:50 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:22:50 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:50 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a6de1095-eb61-427a-8857-e8ada6cd11dc Sep 28 16:22:50 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:50 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.347s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:50 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] Deleted volume successfully. Sep 28 16:22:50 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a6de1095-eb61-427a-8857-e8ada6cd11dc" returned: 0 in 0.359s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f64aaaf8-cee8-413e-a3f6-e7e16b129925 tempest-VolumeDependencyTests-1333096594 None] Lock "cinder-e90855b8-7d1b-4412-b054-94bd92468e35-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1307ae7-62e9-4247-acaa-07d86438228b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6de1095-eb61-427a-8857-e8ada6cd11dc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b9b4f9-9c64-456c-92ce-114b5704c30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:50 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Volume volume-a6de1095-eb61-427a-8857-e8ada6cd11dc (a6de1095-eb61-427a-8857-e8ada6cd11dc): created successfully Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b9b4f9-9c64-456c-92ce-114b5704c30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Flow 'volume_create_manager' (c80a295e-2b5e-4b0b-8da1-bb0cfee67ec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:50 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-99981f5c-d2c5-4dc7-87d5-d4ccced28017 tempest-CinderUnicodeTest-1275792299 None] Created volume successfully. Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Flow 'volume_create_manager' (218cf6bd-312b-489f-b2bd-34e65d4375b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbd2c66-7489-40ec-a773-380318e87620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbd2c66-7489-40ec-a773-380318e87620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-978819923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940d9348-e718-484b-b960-b85af542e11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1609af3fd6ee4767b26493db71dd26b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:51Z,use_quota=True,user_id='3acda8724fa147e48edf77b81cdb2e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74cb9de5-869a-4193-bed0-d6a54141bf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74cb9de5-869a-4193-bed0-d6a54141bf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87df73b-a0d6-46f8-9166-63ab64f8d862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87df73b-a0d6-46f8-9166-63ab64f8d862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '940d9348-e718-484b-b960-b85af542e11f', 'volume_name': 'volume-940d9348-e718-484b-b960-b85af542e11f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32428631-5eb6-4cb1-b566-29c6d318a31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32428631-5eb6-4cb1-b566-29c6d318a31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15330ab5-72ed-4f5a-88b9-0bb7f7404f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:50 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Volume 940d9348-e718-484b-b960-b85af542e11f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-940d9348-e718-484b-b960-b85af542e11f', 'volume_size': 1} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-978819923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940d9348-e718-484b-b960-b85af542e11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1609af3fd6ee4767b26493db71dd26b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:51Z,use_quota=True,user_id='3acda8724fa147e48edf77b81cdb2e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Creating volume 940d9348-e718-484b-b960-b85af542e11f {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:50 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-940d9348-e718-484b-b960-b85af542e11f 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:50 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-940d9348-e718-484b-b960-b85af542e11f 1073741824 Sep 28 16:22:50 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:51 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Flow 'volume_create_manager' (da774bae-66ae-4b9c-a8f6-8422384fdde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a48985-1ca4-4a81-9e4f-54bc4c22c38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a48985-1ca4-4a81-9e4f-54bc4c22c38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-496665319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f43637c-5359-45ee-a1c5-77c0c86c8c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1609af3fd6ee4767b26493db71dd26b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:51Z,use_quota=True,user_id='3acda8724fa147e48edf77b81cdb2e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c387fc-0815-4969-92fb-693b1d64ccde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c387fc-0815-4969-92fb-693b1d64ccde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c7b0ee-3c72-49a9-a97f-ff2a6b891f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c7b0ee-3c72-49a9-a97f-ff2a6b891f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f43637c-5359-45ee-a1c5-77c0c86c8c07', 'volume_name': 'volume-4f43637c-5359-45ee-a1c5-77c0c86c8c07', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e74a956-11f5-4fde-bfe2-eb81b8c2f5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:51 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e74a956-11f5-4fde-bfe2-eb81b8c2f5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb12219d-f6cf-45d7-9e88-6518b4fe467e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:51 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Volume 4f43637c-5359-45ee-a1c5-77c0c86c8c07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f43637c-5359-45ee-a1c5-77c0c86c8c07', 'volume_size': 1} Sep 28 16:22:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-940d9348-e718-484b-b960-b85af542e11f 1073741824" returned: 0 in 0.725s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-940d9348-e718-484b-b960-b85af542e11f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:51 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-940d9348-e718-484b-b960-b85af542e11f Sep 28 16:22:51 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:52 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Flow 'volume_create_manager' (191bbaea-6e2c-4da0-a9a5-037c6445e40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895a9281-613b-4665-9974-a0f7a4085fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-940d9348-e718-484b-b960-b85af542e11f" returned: 0 in 0.582s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.661s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-496665319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f43637c-5359-45ee-a1c5-77c0c86c8c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1609af3fd6ee4767b26493db71dd26b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:51Z,use_quota=True,user_id='3acda8724fa147e48edf77b81cdb2e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Creating volume 4f43637c-5359-45ee-a1c5-77c0c86c8c07 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:52 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f43637c-5359-45ee-a1c5-77c0c86c8c07 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895a9281-613b-4665-9974-a0f7a4085fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1056339594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1609af3fd6ee4767b26493db71dd26b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:52Z,use_quota=True,user_id='3acda8724fa147e48edf77b81cdb2e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ee075f-d409-4117-8d93-7c59aa1dd096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ee075f-d409-4117-8d93-7c59aa1dd096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:52 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f43637c-5359-45ee-a1c5-77c0c86c8c07 1073741824 Sep 28 16:22:52 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215c0a58-73af-4ce5-987a-741b46f10e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215c0a58-73af-4ce5-987a-741b46f10e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf', 'volume_name': 'volume-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fba88fa-926f-49a2-be6d-c736badbfb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fba88fa-926f-49a2-be6d-c736badbfb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9547e5ff-da49-4845-81ff-29f74cf102f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:52 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Volume 0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf', 'volume_size': 1} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15330ab5-72ed-4f5a-88b9-0bb7f7404f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-940d9348-e718-484b-b960-b85af542e11f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa63c14-7234-428d-b640-bfce5293c7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Flow 'volume_create_manager' (e9784e6f-3de2-4a23-b8c7-09841992b14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be98565-07a6-4454-8304-70502edf33e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:52 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Volume volume-940d9348-e718-484b-b960-b85af542e11f (940d9348-e718-484b-b960-b85af542e11f): created successfully Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa63c14-7234-428d-b640-bfce5293c7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Flow 'volume_create_manager' (218cf6bd-312b-489f-b2bd-34e65d4375b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be98565-07a6-4454-8304-70502edf33e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-90054653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ce16d8-2fa4-4d78-8297-d6e79d220c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7450133953dc42bc96e4113d16a5eb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:52Z,use_quota=True,user_id='ffc597531cc541ce8ddc9f6ac2ca8be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0ce857-21da-4057-89d9-921ce67cabb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0ce857-21da-4057-89d9-921ce67cabb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c69df8ac-d8a7-46e7-96ab-dfc6a223e174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c69df8ac-d8a7-46e7-96ab-dfc6a223e174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ce16d8-2fa4-4d78-8297-d6e79d220c5b', 'volume_name': 'volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d25e546-4210-4bfe-9831-c8f8ec0da18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d25e546-4210-4bfe-9831-c8f8ec0da18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079f81d1-bf78-4c1a-9ba6-835965257d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:52 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Volume 93ce16d8-2fa4-4d78-8297-d6e79d220c5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b', 'volume_size': 1} Sep 28 16:22:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:52 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5a04c74a-b7e4-411c-9b23-ebc7ae0c2a40 tempest-CreateVolumesFromSnapshotTest-216412147 None] Created volume successfully. Sep 28 16:22:53 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f43637c-5359-45ee-a1c5-77c0c86c8c07 1073741824" returned: 0 in 0.830s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f43637c-5359-45ee-a1c5-77c0c86c8c07 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:53 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f43637c-5359-45ee-a1c5-77c0c86c8c07 Sep 28 16:22:53 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Flow 'volume_create_manager' (78646d5f-db08-4918-b8d6-b4b8a4557e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea32ddaf-ca95-4c1b-8aee-2b7a159fbda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea32ddaf-ca95-4c1b-8aee-2b7a159fbda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1584573195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25f9d45-92aa-487e-bf58-7a1dd424d797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1609af3fd6ee4767b26493db71dd26b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:53Z,use_quota=True,user_id='3acda8724fa147e48edf77b81cdb2e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5bb9df-716d-4198-ab2f-4152f68c0a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5bb9df-716d-4198-ab2f-4152f68c0a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a193a2-bb6e-4bbd-b43e-1b869ec2dc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a193a2-bb6e-4bbd-b43e-1b869ec2dc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b25f9d45-92aa-487e-bf58-7a1dd424d797', 'volume_name': 'volume-b25f9d45-92aa-487e-bf58-7a1dd424d797', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ed0512-1bcf-45f3-aac5-ba2c1af089fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ed0512-1bcf-45f3-aac5-ba2c1af089fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222f2226-78f5-49c9-ad5d-7f6222b75cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:53 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Volume b25f9d45-92aa-487e-bf58-7a1dd424d797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b25f9d45-92aa-487e-bf58-7a1dd424d797', 'volume_size': 1} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:53 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f43637c-5359-45ee-a1c5-77c0c86c8c07" returned: 0 in 0.393s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.207s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1056339594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1609af3fd6ee4767b26493db71dd26b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:52Z,use_quota=True,user_id='3acda8724fa147e48edf77b81cdb2e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Creating volume 0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:53 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:53 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf 1073741824 Sep 28 16:22:53 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb12219d-f6cf-45d7-9e88-6518b4fe467e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f43637c-5359-45ee-a1c5-77c0c86c8c07', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144992dc-3123-44c4-bc51-d36e9216f5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:53 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Volume volume-4f43637c-5359-45ee-a1c5-77c0c86c8c07 (4f43637c-5359-45ee-a1c5-77c0c86c8c07): created successfully Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144992dc-3123-44c4-bc51-d36e9216f5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Flow 'volume_create_manager' (da774bae-66ae-4b9c-a8f6-8422384fdde2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Flow 'volume_create_manager' (f44f9ef7-4b4f-461b-aaa7-10ded30cbfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2facf10-da0a-4385-a4d1-096fec50bbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2facf10-da0a-4385-a4d1-096fec50bbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-973655090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1edbd22-ecc1-4633-9585-94442703becc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72cd68a356e4578ac9a0508505b8e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:54Z,use_quota=True,user_id='4a87750ad78f48c9a22641affe447cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4daa0907-dbf7-4bfb-92d6-bdbd3212420b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4daa0907-dbf7-4bfb-92d6-bdbd3212420b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93b8028-ba5a-4708-9a12-d66cb1314102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93b8028-ba5a-4708-9a12-d66cb1314102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1edbd22-ecc1-4633-9585-94442703becc', 'volume_name': 'volume-a1edbd22-ecc1-4633-9585-94442703becc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155349d5-1f31-4d6a-b969-5d3940df2733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155349d5-1f31-4d6a-b969-5d3940df2733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6ec557-d429-4348-883c-9d22ed512ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:53 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Volume a1edbd22-ecc1-4633-9585-94442703becc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1edbd22-ecc1-4633-9585-94442703becc', 'volume_size': 1} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Flow 'volume_create_manager' (bbf64e79-e6f1-4b69-a542-88936a528f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720492be-4bc5-4255-8550-ff462d649e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:53 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e0d39679-8166-4853-a4ab-bb1b8b274527 tempest-CreateVolumesFromSnapshotTest-216412147 None] Created volume successfully. Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720492be-4bc5-4255-8550-ff462d649e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-745366014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1609af3fd6ee4767b26493db71dd26b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:54Z,use_quota=True,user_id='3acda8724fa147e48edf77b81cdb2e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc890122-3a67-4606-afa8-25237f95e2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc890122-3a67-4606-afa8-25237f95e2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8826ad4e-acbd-461d-bd23-045a058ab1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8826ad4e-acbd-461d-bd23-045a058ab1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18', 'volume_name': 'volume-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45fa28ea-9939-4a89-8988-d482388a1682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45fa28ea-9939-4a89-8988-d482388a1682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d35190d-2b2e-4161-93d7-3d4c4877a486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:53 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Volume f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18', 'volume_size': 1} Sep 28 16:22:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:54 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf 1073741824" returned: 0 in 0.610s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:54 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf Sep 28 16:22:54 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:54 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf" returned: 0 in 0.269s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.843s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-90054653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ce16d8-2fa4-4d78-8297-d6e79d220c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7450133953dc42bc96e4113d16a5eb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:52Z,use_quota=True,user_id='ffc597531cc541ce8ddc9f6ac2ca8be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Creating volume 93ce16d8-2fa4-4d78-8297-d6e79d220c5b {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:54 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9547e5ff-da49-4845-81ff-29f74cf102f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:54 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b 1073741824 Sep 28 16:22:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12cda90d-f2e1-44ae-973a-82a9cafebfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:54 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:54 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Volume volume-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf (0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf): created successfully Sep 28 16:22:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12cda90d-f2e1-44ae-973a-82a9cafebfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Flow 'volume_create_manager' (191bbaea-6e2c-4da0-a9a5-037c6445e40f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:54 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8d63bbb7-c7bc-45a0-8e36-9b65f15c586b tempest-CreateVolumesFromSnapshotTest-216412147 None] Created volume successfully. Sep 28 16:22:55 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b 1073741824" returned: 0 in 0.521s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:55 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b Sep 28 16:22:55 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:55 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b" returned: 0 in 0.268s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.926s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1584573195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25f9d45-92aa-487e-bf58-7a1dd424d797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1609af3fd6ee4767b26493db71dd26b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:53Z,use_quota=True,user_id='3acda8724fa147e48edf77b81cdb2e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Creating volume b25f9d45-92aa-487e-bf58-7a1dd424d797 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:55 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b25f9d45-92aa-487e-bf58-7a1dd424d797 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079f81d1-bf78-4c1a-9ba6-835965257d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:55 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b25f9d45-92aa-487e-bf58-7a1dd424d797 1073741824 Sep 28 16:22:55 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc188cfd-c255-46d0-84e0-f46b9521c261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:55 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Volume volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b (93ce16d8-2fa4-4d78-8297-d6e79d220c5b): created successfully Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc188cfd-c255-46d0-84e0-f46b9521c261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Flow 'volume_create_manager' (e9784e6f-3de2-4a23-b8c7-09841992b14b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:55 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4bc80adc-d98f-46fb-a68c-55c0fba37dbe tempest-ProjectMemberTests-462857659 None] Created volume successfully. Sep 28 16:22:55 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b25f9d45-92aa-487e-bf58-7a1dd424d797 1073741824" returned: 0 in 0.572s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Flow 'volume_create_manager' (69d066d1-5dd5-4c75-b0ae-ec34129a8146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d207be64-52eb-4c1c-a8c8-6a37e29a056a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d207be64-52eb-4c1c-a8c8-6a37e29a056a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-795915560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1396cae4-582b-43d4-8a6b-5dfad4a0705c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ae7215c3f8d4903b7d7902e311345cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:56Z,use_quota=True,user_id='397c066939cd4186859cbc90175a4a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17da470-3781-4de4-beaf-8fed243ff3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17da470-3781-4de4-beaf-8fed243ff3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52e84ff-5b08-4118-9cb4-7c5a37568b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52e84ff-5b08-4118-9cb4-7c5a37568b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1396cae4-582b-43d4-8a6b-5dfad4a0705c', 'volume_name': 'volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2684293-38ce-4a58-baa1-ce2cdb23eb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2684293-38ce-4a58-baa1-ce2cdb23eb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be873a1-f79b-441f-9f74-a9f8d8637148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:56 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Volume 1396cae4-582b-43d4-8a6b-5dfad4a0705c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c', 'volume_size': 1} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b25f9d45-92aa-487e-bf58-7a1dd424d797 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:56 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b25f9d45-92aa-487e-bf58-7a1dd424d797 Sep 28 16:22:56 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:56 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b25f9d45-92aa-487e-bf58-7a1dd424d797" returned: 0 in 0.285s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.579s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-973655090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1edbd22-ecc1-4633-9585-94442703becc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72cd68a356e4578ac9a0508505b8e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:54Z,use_quota=True,user_id='4a87750ad78f48c9a22641affe447cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Creating volume a1edbd22-ecc1-4633-9585-94442703becc {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:56 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222f2226-78f5-49c9-ad5d-7f6222b75cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b25f9d45-92aa-487e-bf58-7a1dd424d797', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572f25e1-083a-4fd3-9d93-5e33d7003953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:56 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc 1073741824 Sep 28 16:22:56 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:56 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Volume volume-b25f9d45-92aa-487e-bf58-7a1dd424d797 (b25f9d45-92aa-487e-bf58-7a1dd424d797): created successfully Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572f25e1-083a-4fd3-9d93-5e33d7003953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Flow 'volume_create_manager' (78646d5f-db08-4918-b8d6-b4b8a4557e86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:56 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-19958a2e-eff0-4f66-83d4-a6de3dbf90cf tempest-CreateVolumesFromSnapshotTest-216412147 None] Created volume successfully. Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-209c8741-944e-40e6-8cf2-2d42fb2b36c1 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:56 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc 1073741824" returned: 0 in 0.581s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:57 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc Sep 28 16:22:57 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:57 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc" returned: 0 in 0.284s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.404s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-745366014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1609af3fd6ee4767b26493db71dd26b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:54Z,use_quota=True,user_id='3acda8724fa147e48edf77b81cdb2e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Creating volume f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:57 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6ec557-d429-4348-883c-9d22ed512ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1edbd22-ecc1-4633-9585-94442703becc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:57 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18 1073741824 Sep 28 16:22:57 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9461bc51-379b-4cc3-8e59-15385c7e6a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:57 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Volume volume-a1edbd22-ecc1-4633-9585-94442703becc (a1edbd22-ecc1-4633-9585-94442703becc): created successfully Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9461bc51-379b-4cc3-8e59-15385c7e6a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Flow 'volume_create_manager' (f44f9ef7-4b4f-461b-aaa7-10ded30cbfcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b1bf36e8-ad3c-402f-a18d-c51dc41de6b8 tempest-CinderUnicodeTest-1275792299 None] Created volume successfully. Sep 28 16:22:57 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18 1073741824" returned: 0 in 0.472s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:57 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18 Sep 28 16:22:57 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:58 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18" returned: 0 in 0.271s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.035s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-795915560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1396cae4-582b-43d4-8a6b-5dfad4a0705c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ae7215c3f8d4903b7d7902e311345cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:56Z,use_quota=True,user_id='397c066939cd4186859cbc90175a4a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Creating volume 1396cae4-582b-43d4-8a6b-5dfad4a0705c {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:58 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d35190d-2b2e-4161-93d7-3d4c4877a486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:58 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c 1073741824 Sep 28 16:22:58 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c4f851-8d74-418a-98dc-9493f370438b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:58 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Volume volume-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18 (f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18): created successfully Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c4f851-8d74-418a-98dc-9493f370438b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Flow 'volume_create_manager' (bbf64e79-e6f1-4b69-a542-88936a528f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4ad4e5a6-3b60-40e1-be99-beb663abacdb tempest-CreateVolumesFromSnapshotTest-216412147 None] Created volume successfully. Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2add6204-5392-48af-93f1-c453bf985e92 tempest-CinderUnicodeTest-1275792299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:58 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c 1073741824" returned: 0 in 0.551s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:58 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c Sep 28 16:22:58 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "cinder-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:58 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c" returned: 0 in 0.295s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-209c8741-944e-40e6-8cf2-2d42fb2b36c1 tempest-ProjectMemberTests-462857659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.086s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "cinder-quobyte-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be873a1-f79b-441f-9f74-a9f8d8637148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01993054-d4b9-4f78-89a9-eafe660e3f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-209c8741-944e-40e6-8cf2-2d42fb2b36c1 tempest-ProjectMemberTests-462857659 None] Creating offline snapshot afc97172-b75a-4365-bbd4-e243773e251f of volume 93ce16d8-2fa4-4d78-8297-d6e79d220c5b {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:22:59 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Volume volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c (1396cae4-582b-43d4-8a6b-5dfad4a0705c): created successfully Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01993054-d4b9-4f78-89a9-eafe660e3f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Flow 'volume_create_manager' (69d066d1-5dd5-4c75-b0ae-ec34129a8146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf3d5fd-ad40-4ca1-8aab-57f2745f1a5f]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-quobyte-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18" acquired by "delete_volume" :: waited 0.064s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-209c8741-944e-40e6-8cf2-2d42fb2b36c1 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6315e075-0054-4498-8311-8658bd5d09e7]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:59 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a7368dc3-f5b8-4649-8404-c57914966013 tempest-ProjectReaderTests-895699407 None] Created volume successfully. Sep 28 16:22:59 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b Sep 28 16:22:59 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:59 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18 Sep 28 16:22:59 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:59 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18" returned: 0 in 0.407s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:59 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-209c8741-944e-40e6-8cf2-2d42fb2b36c1 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b" returned: 0 in 0.438s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-209c8741-944e-40e6-8cf2-2d42fb2b36c1 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:59 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18 Sep 28 16:22:59 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:59 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f 1G Sep 28 16:22:59 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:59 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18" returned: 0 in 0.247s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-quobyte-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18" released by "delete_volume" :: held 0.710s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Created reservations ['12422efa-2a36-499d-b3d8-dbe8658b68cf', '034023ce-9c66-4cb2-9695-68db4455ad2c', 'a0b8d7c5-e72d-4b29-99a3-642485d11654', '69d204b5-93a5-4164-95aa-2da5afd3b074'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:59 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:22:59 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:00 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-209c8741-944e-40e6-8cf2-2d42fb2b36c1 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f 1G" returned: 0 in 0.490s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-209c8741-944e-40e6-8cf2-2d42fb2b36c1 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:00 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f Sep 28 16:23:00 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "cinder-b25f9d45-92aa-487e-bf58-7a1dd424d797-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-b25f9d45-92aa-487e-bf58-7a1dd424d797-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "cinder-quobyte-b25f9d45-92aa-487e-bf58-7a1dd424d797" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-quobyte-b25f9d45-92aa-487e-bf58-7a1dd424d797" acquired by "delete_volume" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:00 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.384s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:00 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:00 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5f5ce4-e353-4c2b-a3b1-78fb1fc90ce9]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Deleted volume successfully. Sep 28 16:23:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b25f9d45-92aa-487e-bf58-7a1dd424d797 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8d3ca256-e474-4ad8-8b0c-1e05e707edc9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-f9a56a6f-b0ba-42fb-b95b-e5c49fabfb18-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:00 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-209c8741-944e-40e6-8cf2-2d42fb2b36c1 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f" returned: 0 in 0.405s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:00 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-209c8741-944e-40e6-8cf2-2d42fb2b36c1 tempest-ProjectMemberTests-462857659 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f is being set with open permissions: ugo+rw Sep 28 16:23:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-209c8741-944e-40e6-8cf2-2d42fb2b36c1 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:00 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f Sep 28 16:23:00 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:00 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b25f9d45-92aa-487e-bf58-7a1dd424d797 Sep 28 16:23:00 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-77870063-f4a7-4d52-83fa-b09973e6c4a1 tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:00 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-209c8741-944e-40e6-8cf2-2d42fb2b36c1 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f" returned: 0 in 0.315s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:00 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b25f9d45-92aa-487e-bf58-7a1dd424d797" returned: 0 in 0.433s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b25f9d45-92aa-487e-bf58-7a1dd424d797 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:00 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b25f9d45-92aa-487e-bf58-7a1dd424d797 Sep 28 16:23:00 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-209c8741-944e-40e6-8cf2-2d42fb2b36c1 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:00 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.info Sep 28 16:23:00 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:01 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b25f9d45-92aa-487e-bf58-7a1dd424d797" returned: 0 in 0.294s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-quobyte-b25f9d45-92aa-487e-bf58-7a1dd424d797" released by "delete_volume" :: held 0.808s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:01 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-209c8741-944e-40e6-8cf2-2d42fb2b36c1 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.info" returned: 0 in 0.288s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:01 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-209c8741-944e-40e6-8cf2-2d42fb2b36c1 tempest-ProjectMemberTests-462857659 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.info is being set with open permissions: ugo+rw Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-209c8741-944e-40e6-8cf2-2d42fb2b36c1 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:01 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.info Sep 28 16:23:01 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] Created reservations ['144561b6-81a2-4226-baa6-c135eae56893', 'aedc71d4-e888-46bd-a928-4a6120ba2119', '618d0a0d-3360-4219-a72f-a32cea283060', '746db93d-45f9-4e47-80e9-3c3abe8ffaab'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:01 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:01 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:01 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-209c8741-944e-40e6-8cf2-2d42fb2b36c1 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.info" returned: 0 in 0.266s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-209c8741-944e-40e6-8cf2-2d42fb2b36c1 tempest-ProjectMemberTests-462857659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.386s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2add6204-5392-48af-93f1-c453bf985e92 tempest-CinderUnicodeTest-1275792299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.957s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2add6204-5392-48af-93f1-c453bf985e92 tempest-CinderUnicodeTest-1275792299 None] Creating offline snapshot f8e9c711-2663-43c9-bfdc-c7a4221fa98c of volume a1edbd22-ecc1-4633-9585-94442703becc {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "cinder-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fed298-90da-45bc-b6fa-02c99359f0c8]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2add6204-5392-48af-93f1-c453bf985e92 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:01 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-209c8741-944e-40e6-8cf2-2d42fb2b36c1 tempest-ProjectMemberTests-462857659 None] Create snapshot completed successfully Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "cinder-quobyte-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-quobyte-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19bc3d4-6ca4-4c83-80a4-948f8541717f]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:01 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.361s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:01 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] Deleted volume successfully. Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a54e612d-3f80-4d3f-8ea0-04eff446f71f tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-b25f9d45-92aa-487e-bf58-7a1dd424d797-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:01 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc Sep 28 16:23:01 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:01 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf Sep 28 16:23:01 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:01 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2add6204-5392-48af-93f1-c453bf985e92 tempest-CinderUnicodeTest-1275792299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc" returned: 0 in 0.477s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2add6204-5392-48af-93f1-c453bf985e92 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:01 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c 1G Sep 28 16:23:01 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:02 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf" returned: 0 in 0.438s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:02 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf Sep 28 16:23:02 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-afc97172-b75a-4365-bbd4-e243773e251f-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] Lock "cinder-afc97172-b75a-4365-bbd4-e243773e251f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-93ce16d8-2fa4-4d78-8297-d6e79d220c5b" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-93ce16d8-2fa4-4d78-8297-d6e79d220c5b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-afc97172-b75a-4365-bbd4-e243773e251f" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-afc97172-b75a-4365-bbd4-e243773e251f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] Deleting offline snapshot afc97172-b75a-4365-bbd4-e243773e251f of volume 93ce16d8-2fa4-4d78-8297-d6e79d220c5b {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] snapshot_file for this snap is: volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e7af9c-f7b0-4d76-b5d7-3dd396e40d83]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:02 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf" returned: 0 in 0.338s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-quobyte-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf" released by "delete_volume" :: held 0.841s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:02 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f Sep 28 16:23:02 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] Created reservations ['7f182644-1143-4ba7-b2d5-3319fbe33fc1', 'f63189cc-e93a-4a40-9257-e26d4da7c1c0', '0863c3df-def1-42e1-893e-39db23b384ca', '20ae6491-97d2-4371-ba3c-5b5454c5472b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:02 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2add6204-5392-48af-93f1-c453bf985e92 tempest-CinderUnicodeTest-1275792299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c 1G" returned: 0 in 0.542s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2add6204-5392-48af-93f1-c453bf985e92 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1edbd22-ecc1-4633-9585-94442703becc -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:02 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1edbd22-ecc1-4633-9585-94442703becc -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c Sep 28 16:23:02 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:02 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:02 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "cinder-4f43637c-5359-45ee-a1c5-77c0c86c8c07-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-4f43637c-5359-45ee-a1c5-77c0c86c8c07-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "cinder-quobyte-4f43637c-5359-45ee-a1c5-77c0c86c8c07" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:02 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f" returned: 0 in 0.548s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-quobyte-4f43637c-5359-45ee-a1c5-77c0c86c8c07" acquired by "delete_volume" :: waited 0.063s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[34436e41-a0f0-432e-a4a6-24ac55298851]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fe4f98-d92b-4ebd-b94d-56ef82c404e8]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f43637c-5359-45ee-a1c5-77c0c86c8c07 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:02 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:02 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2add6204-5392-48af-93f1-c453bf985e92 tempest-CinderUnicodeTest-1275792299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1edbd22-ecc1-4633-9585-94442703becc -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c" returned: 0 in 0.513s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:02 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-2add6204-5392-48af-93f1-c453bf985e92 tempest-CinderUnicodeTest-1275792299 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c is being set with open permissions: ugo+rw Sep 28 16:23:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2add6204-5392-48af-93f1-c453bf985e92 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.422s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] Deleted volume successfully. Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-75d04cfc-7092-484d-abe2-6b3603680634 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-0aa5d5a5-2b2f-46e4-b32d-5b70c0dfaccf-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:03 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c Sep 28 16:23:03 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:03 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b Sep 28 16:23:03 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:03 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f43637c-5359-45ee-a1c5-77c0c86c8c07 Sep 28 16:23:03 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:03 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2add6204-5392-48af-93f1-c453bf985e92 tempest-CinderUnicodeTest-1275792299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c" returned: 0 in 0.329s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2add6204-5392-48af-93f1-c453bf985e92 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:03 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b" returned: 0 in 0.452s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:03 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:03 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.info Sep 28 16:23:03 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f43637c-5359-45ee-a1c5-77c0c86c8c07" returned: 0 in 0.454s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f43637c-5359-45ee-a1c5-77c0c86c8c07 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:03 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f Sep 28 16:23:03 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:03 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f43637c-5359-45ee-a1c5-77c0c86c8c07 Sep 28 16:23:03 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:03 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2add6204-5392-48af-93f1-c453bf985e92 tempest-CinderUnicodeTest-1275792299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.info" returned: 0 in 0.293s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:03 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-2add6204-5392-48af-93f1-c453bf985e92 tempest-CinderUnicodeTest-1275792299 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.info is being set with open permissions: ugo+rw Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2add6204-5392-48af-93f1-c453bf985e92 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:03 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.info Sep 28 16:23:03 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:03 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-4f43637c-5359-45ee-a1c5-77c0c86c8c07" returned: 0 in 0.341s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-quobyte-4f43637c-5359-45ee-a1c5-77c0c86c8c07" released by "delete_volume" :: held 0.852s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:03 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f" returned: 0 in 0.440s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Created reservations ['da933d4e-8cc0-4868-9a7b-100472633383', '163e2c2d-d6f6-474e-82a4-8c72d2ea377c', '0077f388-b97f-4745-a693-83e6845f9d6a', 'e27b9fff-47cc-46d3-a205-98d44ae3741f'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:03 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f Sep 28 16:23:03 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:03 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:03 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:04 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2add6204-5392-48af-93f1-c453bf985e92 tempest-CinderUnicodeTest-1275792299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.info" returned: 0 in 0.383s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2add6204-5392-48af-93f1-c453bf985e92 tempest-CinderUnicodeTest-1275792299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.669s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-77870063-f4a7-4d52-83fa-b09973e6c4a1 tempest-ProjectReaderTests-895699407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.541s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-77870063-f4a7-4d52-83fa-b09973e6c4a1 tempest-ProjectReaderTests-895699407 None] Creating offline snapshot bfc3f621-76f7-427f-912a-61bbc5c9b21d of volume 1396cae4-582b-43d4-8a6b-5dfad4a0705c {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:23:04 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2add6204-5392-48af-93f1-c453bf985e92 tempest-CinderUnicodeTest-1275792299 None] Create snapshot completed successfully Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2a43e0-e18a-4d8a-a36f-90e36bc783f6]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77870063-f4a7-4d52-83fa-b09973e6c4a1 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:04 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b.afc97172-b75a-4365-bbd4-e243773e251f" returned: 0 in 0.353s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-afc97172-b75a-4365-bbd4-e243773e251f" released by "_delete_snapshot" :: held 1.963s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-93ce16d8-2fa4-4d78-8297-d6e79d220c5b" released by "delete_snapshot" :: held 1.990s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:04 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.317s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:04 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Deleted volume successfully. Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-10883ad0-35dc-40e5-9db3-6fdd5aabc8e9 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-4f43637c-5359-45ee-a1c5-77c0c86c8c07-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:04 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c Sep 28 16:23:04 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] Created reservations ['4ca8a772-afac-457d-9d2a-dfda060b7869', '4045e6b8-27c7-4488-8cfd-30e7d26fbba1', '2a4c74bd-a9cb-4946-ae6a-fe394fa03fdf', 'a1143b17-d64f-44bb-b707-eed96657a31b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:04 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] Delete snapshot completed successfully. Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a8f9fbf7-89a5-4fdf-a1b3-87a2fe2356c9 tempest-ProjectMemberTests-462857659 None] Lock "cinder-afc97172-b75a-4365-bbd4-e243773e251f-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:04 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77870063-f4a7-4d52-83fa-b09973e6c4a1 tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c" returned: 0 in 0.462s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77870063-f4a7-4d52-83fa-b09973e6c4a1 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:04 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d 1G Sep 28 16:23:04 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] Acquiring lock "cinder-f8e9c711-2663-43c9-bfdc-c7a4221fa98c-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] Lock "cinder-f8e9c711-2663-43c9-bfdc-c7a4221fa98c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] Acquiring lock "cinder-quobyte-a1edbd22-ecc1-4633-9585-94442703becc" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] Lock "cinder-quobyte-a1edbd22-ecc1-4633-9585-94442703becc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] Acquiring lock "cinder-quobyte-f8e9c711-2663-43c9-bfdc-c7a4221fa98c" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] Lock "cinder-quobyte-f8e9c711-2663-43c9-bfdc-c7a4221fa98c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] Deleting offline snapshot f8e9c711-2663-43c9-bfdc-c7a4221fa98c of volume a1edbd22-ecc1-4633-9585-94442703becc {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] snapshot_file for this snap is: volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfaee08-6f24-4929-9fae-7bb3d9ed60ea]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "cinder-940d9348-e718-484b-b960-b85af542e11f-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-940d9348-e718-484b-b960-b85af542e11f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "cinder-quobyte-940d9348-e718-484b-b960-b85af542e11f" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:05 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-quobyte-940d9348-e718-484b-b960-b85af542e11f" acquired by "delete_volume" :: waited 0.035s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:05 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c Sep 28 16:23:05 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77870063-f4a7-4d52-83fa-b09973e6c4a1 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d 1G" returned: 0 in 0.558s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77870063-f4a7-4d52-83fa-b09973e6c4a1 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e500cda-faac-4790-a3e2-e191be35d44b]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:05 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d Sep 28 16:23:05 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-940d9348-e718-484b-b960-b85af542e11f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:05 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-940d9348-e718-484b-b960-b85af542e11f Sep 28 16:23:05 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-93ce16d8-2fa4-4d78-8297-d6e79d220c5b-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:05 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77870063-f4a7-4d52-83fa-b09973e6c4a1 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d" returned: 0 in 0.351s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:05 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-77870063-f4a7-4d52-83fa-b09973e6c4a1 tempest-ProjectReaderTests-895699407 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d is being set with open permissions: ugo+rw Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77870063-f4a7-4d52-83fa-b09973e6c4a1 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:05 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] Lock "cinder-93ce16d8-2fa4-4d78-8297-d6e79d220c5b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c" returned: 0 in 0.562s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1edbd22-ecc1-4633-9585-94442703becc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:23:05 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d Sep 28 16:23:05 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0a1c9a-df44-482d-b4b4-b51fb3b80c3a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-93ce16d8-2fa4-4d78-8297-d6e79d220c5b" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-93ce16d8-2fa4-4d78-8297-d6e79d220c5b" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9172296b-5317-4960-988f-416cf253fe9d]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:05 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:05 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc Sep 28 16:23:05 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-940d9348-e718-484b-b960-b85af542e11f" returned: 0 in 0.585s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-940d9348-e718-484b-b960-b85af542e11f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:05 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-940d9348-e718-484b-b960-b85af542e11f Sep 28 16:23:05 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:05 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77870063-f4a7-4d52-83fa-b09973e6c4a1 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d" returned: 0 in 0.361s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77870063-f4a7-4d52-83fa-b09973e6c4a1 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:05 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b Sep 28 16:23:05 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:05 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.info Sep 28 16:23:05 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:06 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:06 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-940d9348-e718-484b-b960-b85af542e11f" returned: 0 in 0.369s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc" returned: 0 in 0.549s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-quobyte-940d9348-e718-484b-b960-b85af542e11f" released by "delete_volume" :: held 1.051s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:06 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c Sep 28 16:23:06 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] Created reservations ['40c47c97-8d3c-48e5-b5af-51b55debd562', '2d5c6b50-a64d-4f12-8cd4-b6251517bf04', 'de545f2c-54db-4824-87f8-1b0b972cc961', 'fd57974d-1b76-434f-bb04-5948f634a334'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:06 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77870063-f4a7-4d52-83fa-b09973e6c4a1 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.info" returned: 0 in 0.371s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:06 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-77870063-f4a7-4d52-83fa-b09973e6c4a1 tempest-ProjectReaderTests-895699407 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.info is being set with open permissions: ugo+rw Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77870063-f4a7-4d52-83fa-b09973e6c4a1 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:06 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.info Sep 28 16:23:06 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:06 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b" returned: 0 in 0.647s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:06 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b Sep 28 16:23:06 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:06 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:06 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:06 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c" returned: 0 in 0.510s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:06 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c Sep 28 16:23:06 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:06 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-77870063-f4a7-4d52-83fa-b09973e6c4a1 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.info" returned: 0 in 0.433s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:06 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-77870063-f4a7-4d52-83fa-b09973e6c4a1 tempest-ProjectReaderTests-895699407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.695s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-93ce16d8-2fa4-4d78-8297-d6e79d220c5b" returned: 0 in 0.382s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:06 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-93ce16d8-2fa4-4d78-8297-d6e79d220c5b" released by "delete_volume" :: held 1.160s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.383s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:06 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] Deleted volume successfully. Sep 28 16:23:06 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-77870063-f4a7-4d52-83fa-b09973e6c4a1 tempest-ProjectReaderTests-895699407 None] Create snapshot completed successfully Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aeaa3398-6ffc-415f-801c-f83cb1dddd69 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-940d9348-e718-484b-b960-b85af542e11f-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] Created reservations ['08e2a9f7-f361-40ba-8438-5e69889a1c1c', '3901da20-47d2-4428-b1d7-2e4d770d78ed', '68f1f4b2-8074-4815-8faf-814742f1da8c', 'e10d1f61-f475-45fe-afed-8337fe2ae9dc'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:06 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc.f8e9c711-2663-43c9-bfdc-c7a4221fa98c" returned: 0 in 0.341s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:07 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:07 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] Lock "cinder-quobyte-f8e9c711-2663-43c9-bfdc-c7a4221fa98c" released by "_delete_snapshot" :: held 2.143s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] Lock "cinder-quobyte-a1edbd22-ecc1-4633-9585-94442703becc" released by "delete_snapshot" :: held 2.175s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] Created reservations ['201b84b6-3427-423d-814c-399a3d41782b', '405a22dc-279b-497a-ba29-690ba7b9ef3d', 'e18c39a2-e104-4e04-9897-833fcc5bef4d', '699a3584-0dcc-4f4d-b5f0-0692d1a14ed9'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] Delete snapshot completed successfully. Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a7ba2e0b-b549-473a-a556-face1950f5f8 tempest-CinderUnicodeTest-1275792299 None] Lock "cinder-f8e9c711-2663-43c9-bfdc-c7a4221fa98c-delete_snapshot" released by "delete_snapshot" :: held 2.350s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:07 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.294s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] Deleted volume successfully. Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aa2d5b08-8e1a-41b3-b03c-85be1b0abce6 tempest-ProjectMemberTests-462857659 None] Lock "cinder-93ce16d8-2fa4-4d78-8297-d6e79d220c5b-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "cinder-d2cb2a62-c8ce-498a-a2c4-a0678d580d38-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-d2cb2a62-c8ce-498a-a2c4-a0678d580d38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "cinder-quobyte-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-quobyte-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "cinder-quobyte-d2cb2a62-c8ce-498a-a2c4-a0678d580d38" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-quobyte-d2cb2a62-c8ce-498a-a2c4-a0678d580d38" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] Deleting offline snapshot d2cb2a62-c8ce-498a-a2c4-a0678d580d38 of volume 7f4df1a9-ffdc-46a6-be25-c971f41c1c6e {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] snapshot_file for this snap is: volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc28525b-10e0-4d18-9445-cd0f983cb1fa]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:07 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38 Sep 28 16:23:07 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:07 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38" returned: 0 in 0.453s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8d7b26-a8ca-4c74-8d4b-8ecc528e9f01]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:08 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e Sep 28 16:23:08 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-bfc3f621-76f7-427f-912a-61bbc5c9b21d-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] Lock "cinder-bfc3f621-76f7-427f-912a-61bbc5c9b21d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-quobyte-1396cae4-582b-43d4-8a6b-5dfad4a0705c" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] Acquiring lock "cinder-a1edbd22-ecc1-4633-9585-94442703becc-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-1396cae4-582b-43d4-8a6b-5dfad4a0705c" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-quobyte-bfc3f621-76f7-427f-912a-61bbc5c9b21d" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] Lock "cinder-a1edbd22-ecc1-4633-9585-94442703becc-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-bfc3f621-76f7-427f-912a-61bbc5c9b21d" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] Deleting offline snapshot bfc3f621-76f7-427f-912a-61bbc5c9b21d of volume 1396cae4-582b-43d4-8a6b-5dfad4a0705c {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] snapshot_file for this snap is: volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba22c35-dd2e-4e94-acea-15e6ea73bce3]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Flow 'volume_create_manager' (87e7a420-e61f-4e83-b3af-878749867033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81909c71-a9ef-453a-9777-69c71afc8963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] Acquiring lock "cinder-quobyte-a1edbd22-ecc1-4633-9585-94442703becc" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81909c71-a9ef-453a-9777-69c71afc8963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1905231438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c9f9d8-aa51-464d-bd03-f3754d4ef14c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7450133953dc42bc96e4113d16a5eb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:08Z,use_quota=True,user_id='ffc597531cc541ce8ddc9f6ac2ca8be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510dd029-4ec2-46ed-9b53-2af736a958fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510dd029-4ec2-46ed-9b53-2af736a958fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:08 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d Sep 28 16:23:08 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3beec9b2-09ce-492b-9cbe-3e44e4941010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3beec9b2-09ce-492b-9cbe-3e44e4941010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78c9f9d8-aa51-464d-bd03-f3754d4ef14c', 'volume_name': 'volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0262bae9-a128-43ed-a499-c69578c3331e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0262bae9-a128-43ed-a499-c69578c3331e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:08 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99492c1f-4ead-4f74-9949-d75b3f526a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:08 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Volume 78c9f9d8-aa51-464d-bd03-f3754d4ef14c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c', 'volume_size': 1} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1905231438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c9f9d8-aa51-464d-bd03-f3754d4ef14c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7450133953dc42bc96e4113d16a5eb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:08Z,use_quota=True,user_id='ffc597531cc541ce8ddc9f6ac2ca8be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Creating volume 78c9f9d8-aa51-464d-bd03-f3754d4ef14c {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:23:08 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e" returned: 0 in 0.657s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] Lock "cinder-quobyte-a1edbd22-ecc1-4633-9585-94442703becc" acquired by "delete_volume" :: waited 0.107s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:08 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c 1073741824 Sep 28 16:23:08 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:08 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38 Sep 28 16:23:08 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f1b7b3-9ee5-491b-8156-57f5024dadc7]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:08 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc Sep 28 16:23:08 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:08 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d" returned: 0 in 0.413s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7831fe9-bc97-40b7-81b5-39050b9b12c2]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:09 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c Sep 28 16:23:09 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:09 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38" returned: 0 in 0.449s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:09 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38 Sep 28 16:23:09 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:09 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc" returned: 0 in 0.463s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:09 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc Sep 28 16:23:09 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:09 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c 1073741824" returned: 0 in 0.653s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:09 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c Sep 28 16:23:09 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:09 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e.d2cb2a62-c8ce-498a-a2c4-a0678d580d38" returned: 0 in 0.304s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:09 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c" returned: 0 in 0.553s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-quobyte-d2cb2a62-c8ce-498a-a2c4-a0678d580d38" released by "_delete_snapshot" :: held 2.077s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-quobyte-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e" released by "delete_snapshot" :: held 2.113s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:09 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d Sep 28 16:23:09 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:09 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a1edbd22-ecc1-4633-9585-94442703becc" returned: 0 in 0.367s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] Lock "cinder-quobyte-a1edbd22-ecc1-4633-9585-94442703becc" released by "delete_volume" :: held 0.926s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] Created reservations ['e90e155a-e80b-452f-8d29-a782ae962115', '6f20b22e-767d-4bb5-a807-b4d8b9cfbcb8', '17982dd7-faf7-4272-92d6-e854410ca5ca', 'e097f7c9-dee8-4232-b08a-7382afa3be9e'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] Created reservations ['39143072-0efb-4875-859f-c89c00f09fbe', 'a7fb3e9d-acbd-48eb-a114-c8755d87da90', '5ac1ba9a-b34e-4a2f-904b-5a46745c6c11', 'd424bcca-be91-4718-b120-bffed30932f4'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:09 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c" returned: 0 in 0.354s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99492c1f-4ead-4f74-9949-d75b3f526a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a718565-3093-4b42-bf44-be32336d6b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:09 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Volume volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c (78c9f9d8-aa51-464d-bd03-f3754d4ef14c): created successfully Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a718565-3093-4b42-bf44-be32336d6b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Flow 'volume_create_manager' (87e7a420-e61f-4e83-b3af-878749867033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:09 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ccb2c8dd-9570-4d8b-8226-b94013b3766a tempest-ProjectMemberTests-462857659 None] Created volume successfully. Sep 28 16:23:09 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] Delete snapshot completed successfully. Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9ff9e596-5cca-4006-a8e7-2e7e0ec1848f tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-d2cb2a62-c8ce-498a-a2c4-a0678d580d38-delete_snapshot" released by "delete_snapshot" :: held 2.408s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:09 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:09 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:09 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d" returned: 0 in 0.427s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:09 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d Sep 28 16:23:09 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:10 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.267s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] Deleted volume successfully. Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ed603c28-4962-419d-a380-8584a295bee0 tempest-CinderUnicodeTest-1275792299 None] Lock "cinder-a1edbd22-ecc1-4633-9585-94442703becc-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:10 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c.bfc3f621-76f7-427f-912a-61bbc5c9b21d" returned: 0 in 0.255s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-bfc3f621-76f7-427f-912a-61bbc5c9b21d" released by "_delete_snapshot" :: held 1.805s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-1396cae4-582b-43d4-8a6b-5dfad4a0705c" released by "delete_snapshot" :: held 1.851s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] Created reservations ['8d2a7ce7-40f0-418e-8afc-996aea7ad337', 'c83b8b51-0e6b-49d4-a67b-ecb6cccb22f2', '5d9d357d-ee6a-4321-9613-27e4af5eeaa6', 'b7d86cec-fde9-4469-aebd-d998255bb93d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] Delete snapshot completed successfully. Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5667de88-eec9-4f04-80c8-27b446f50dd9 tempest-ProjectReaderTests-895699407 None] Lock "cinder-bfc3f621-76f7-427f-912a-61bbc5c9b21d-delete_snapshot" released by "delete_snapshot" :: held 2.049s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-1396cae4-582b-43d4-8a6b-5dfad4a0705c-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] Lock "cinder-1396cae4-582b-43d4-8a6b-5dfad4a0705c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-quobyte-1396cae4-582b-43d4-8a6b-5dfad4a0705c" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-1396cae4-582b-43d4-8a6b-5dfad4a0705c" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "cinder-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a42b13a-b3e4-4c77-bf76-a2142757f779]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "cinder-quobyte-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] Acquiring lock "cinder-a6de1095-eb61-427a-8857-e8ada6cd11dc-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-quobyte-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e" acquired by "delete_volume" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d79b93b9-0578-4e04-8030-041c5a7faf2b tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d79b93b9-0578-4e04-8030-041c5a7faf2b tempest-ProjectMemberTests-462857659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] Lock "cinder-a6de1095-eb61-427a-8857-e8ada6cd11dc-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:10 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c Sep 28 16:23:10 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d79b93b9-0578-4e04-8030-041c5a7faf2b tempest-ProjectMemberTests-462857659 None] Creating offline snapshot 954b25be-2a50-456d-b86f-09fa7b270abb of volume 78c9f9d8-aa51-464d-bd03-f3754d4ef14c {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[578cf3a9-f154-438d-b41b-c8493fc3f104]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cb57db-29ce-4343-b8ca-89c5b8531134]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d79b93b9-0578-4e04-8030-041c5a7faf2b tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] Acquiring lock "cinder-quobyte-a6de1095-eb61-427a-8857-e8ada6cd11dc" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] Lock "cinder-quobyte-a6de1095-eb61-427a-8857-e8ada6cd11dc" acquired by "delete_volume" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4398f1e7-8df6-4e84-9dca-342a81dec03d]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a6de1095-eb61-427a-8857-e8ada6cd11dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:11 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e Sep 28 16:23:11 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:11 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c Sep 28 16:23:11 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:11 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a6de1095-eb61-427a-8857-e8ada6cd11dc Sep 28 16:23:11 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:11 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c" returned: 0 in 0.600s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:11 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c Sep 28 16:23:11 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:11 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e" returned: 0 in 0.473s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:11 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:11 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e Sep 28 16:23:11 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d79b93b9-0578-4e04-8030-041c5a7faf2b tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c" returned: 0 in 0.476s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d79b93b9-0578-4e04-8030-041c5a7faf2b tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:11 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb 1G Sep 28 16:23:11 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:11 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-1396cae4-582b-43d4-8a6b-5dfad4a0705c" returned: 0 in 0.282s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:11 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a6de1095-eb61-427a-8857-e8ada6cd11dc" returned: 0 in 0.502s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a6de1095-eb61-427a-8857-e8ada6cd11dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-1396cae4-582b-43d4-8a6b-5dfad4a0705c" released by "delete_volume" :: held 1.009s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:11 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a6de1095-eb61-427a-8857-e8ada6cd11dc Sep 28 16:23:11 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] Created reservations ['cefd034d-3932-472f-a908-1a740bd03e43', 'f0120587-478c-4635-bc7d-7a1818403dcb', 'bba8ad7c-2d65-43b2-91b8-61d16524d69e', '1098da25-4de9-43ec-b939-4d140ce1d0ba'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:11 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e" returned: 0 in 0.322s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-quobyte-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e" released by "delete_volume" :: held 0.925s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:11 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:11 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:11 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-a6de1095-eb61-427a-8857-e8ada6cd11dc" returned: 0 in 0.357s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] Lock "cinder-quobyte-a6de1095-eb61-427a-8857-e8ada6cd11dc" released by "delete_volume" :: held 0.938s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] Created reservations ['58ad82cb-49fe-4743-ae53-f8de2db744cf', '38047cf7-af86-46db-b468-9883dde23c97', '752854a9-d930-4511-b804-d4dd76f499b4', 'c2886328-43a9-4374-b500-0ca40319e0e5'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] Created reservations ['2e65bd50-c025-4e9a-aec3-d136bc487fa9', 'ade31527-d9a1-4982-83e0-56a4cde11921', 'a00097d4-ae3f-4ab5-877e-bbffefdfa100', 'bc3697c7-d766-4aec-9bed-6579cd28063e'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:12 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d79b93b9-0578-4e04-8030-041c5a7faf2b tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb 1G" returned: 0 in 0.718s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d79b93b9-0578-4e04-8030-041c5a7faf2b tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:12 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:12 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb Sep 28 16:23:12 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.403s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] Deleted volume successfully. Sep 28 16:23:12 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:12 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4e6e2a37-4a36-4d45-b9fb-2a2d92d17736 tempest-ProjectReaderTests-895699407 None] Lock "cinder-1396cae4-582b-43d4-8a6b-5dfad4a0705c-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:12 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:12 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:23:12 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:12 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Flow 'volume_create_manager' (89f5c178-3cf6-42ec-8c0b-94deda561289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:12 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9bed53d-fdc8-4804-927f-49f39b08bb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d79b93b9-0578-4e04-8030-041c5a7faf2b tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb" returned: 0 in 0.510s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.356s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.461s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:12 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-d79b93b9-0578-4e04-8030-041c5a7faf2b tempest-ProjectMemberTests-462857659 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb is being set with open permissions: ugo+rw Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d79b93b9-0578-4e04-8030-041c5a7faf2b tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9bed53d-fdc8-4804-927f-49f39b08bb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-127866436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f1c879-7281-48ae-9776-33bda5797b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ae7215c3f8d4903b7d7902e311345cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:13Z,use_quota=True,user_id='397c066939cd4186859cbc90175a4a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:12 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb Sep 28 16:23:12 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de28b930-4b1b-44e6-8093-b846b1ba9bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de28b930-4b1b-44e6-8093-b846b1ba9bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e07f51-8df5-4f2c-b610-e53160d672c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e07f51-8df5-4f2c-b610-e53160d672c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97f1c879-7281-48ae-9776-33bda5797b45', 'volume_name': 'volume-97f1c879-7281-48ae-9776-33bda5797b45', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f93826b-ed04-4a6e-8cea-69ea63a16621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f93826b-ed04-4a6e-8cea-69ea63a16621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d8b334a-5716-4d32-8b28-aa6b23cfba1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:12 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Volume 97f1c879-7281-48ae-9776-33bda5797b45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97f1c879-7281-48ae-9776-33bda5797b45', 'volume_size': 1} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] Deleted volume successfully. Sep 28 16:23:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] Deleted volume successfully. Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-563d0f00-bc6d-4bfa-bfe6-fe8a754054b7 tempest-CreateVolumesFromSnapshotTest-216412147 None] Lock "cinder-7f4df1a9-ffdc-46a6-be25-c971f41c1c6e-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-11a40c91-d23c-4804-a4b2-664737a81918 tempest-CinderUnicodeTest-1275792299 None] Lock "cinder-a6de1095-eb61-427a-8857-e8ada6cd11dc-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:13 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d79b93b9-0578-4e04-8030-041c5a7faf2b tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb" returned: 0 in 0.274s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d79b93b9-0578-4e04-8030-041c5a7faf2b tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:13 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.info Sep 28 16:23:13 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:13 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d79b93b9-0578-4e04-8030-041c5a7faf2b tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.info" returned: 0 in 0.301s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:13 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-d79b93b9-0578-4e04-8030-041c5a7faf2b tempest-ProjectMemberTests-462857659 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.info is being set with open permissions: ugo+rw Sep 28 16:23:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d79b93b9-0578-4e04-8030-041c5a7faf2b tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:13 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.info Sep 28 16:23:13 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:13 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d79b93b9-0578-4e04-8030-041c5a7faf2b tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.info" returned: 0 in 0.295s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d79b93b9-0578-4e04-8030-041c5a7faf2b tempest-ProjectMemberTests-462857659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.715s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.857s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-127866436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f1c879-7281-48ae-9776-33bda5797b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ae7215c3f8d4903b7d7902e311345cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:13Z,use_quota=True,user_id='397c066939cd4186859cbc90175a4a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:23:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Creating volume 97f1c879-7281-48ae-9776-33bda5797b45 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:23:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:23:13 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:23:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:13 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45 1073741824 Sep 28 16:23:13 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:13 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d79b93b9-0578-4e04-8030-041c5a7faf2b tempest-ProjectMemberTests-462857659 None] Create snapshot completed successfully Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-954b25be-2a50-456d-b86f-09fa7b270abb-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] Lock "cinder-954b25be-2a50-456d-b86f-09fa7b270abb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-78c9f9d8-aa51-464d-bd03-f3754d4ef14c" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-78c9f9d8-aa51-464d-bd03-f3754d4ef14c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-954b25be-2a50-456d-b86f-09fa7b270abb" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-954b25be-2a50-456d-b86f-09fa7b270abb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] Deleting offline snapshot 954b25be-2a50-456d-b86f-09fa7b270abb of volume 78c9f9d8-aa51-464d-bd03-f3754d4ef14c {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] snapshot_file for this snap is: volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e95ffd-a37d-402d-8196-7e1cc74f99b1]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:14 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45 1073741824" returned: 0 in 0.729s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:14 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45 Sep 28 16:23:14 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:14 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb Sep 28 16:23:14 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:14 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45" returned: 0 in 0.372s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d8b334a-5716-4d32-8b28-aa6b23cfba1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f1c879-7281-48ae-9776-33bda5797b45', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c58e49-be6c-4650-b997-0676cc89f7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:14 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Volume volume-97f1c879-7281-48ae-9776-33bda5797b45 (97f1c879-7281-48ae-9776-33bda5797b45): created successfully Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c58e49-be6c-4650-b997-0676cc89f7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Flow 'volume_create_manager' (89f5c178-3cf6-42ec-8c0b-94deda561289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:14 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e3d872ac-057c-4e97-947e-4a4f34dc772e tempest-ProjectReaderTests-895699407 None] Created volume successfully. Sep 28 16:23:14 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb" returned: 0 in 0.596s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:23:15 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6856137-7c87-4fb0-9c5c-9dce9a8d3951]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:15 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c Sep 28 16:23:15 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:15 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c" returned: 0 in 0.459s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:15 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb Sep 28 16:23:15 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:15 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb" returned: 0 in 0.407s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:15 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb Sep 28 16:23:15 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-326875a2-7a02-469c-93d2-fb73b02f3a2c tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-326875a2-7a02-469c-93d2-fb73b02f3a2c tempest-ProjectReaderTests-895699407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-326875a2-7a02-469c-93d2-fb73b02f3a2c tempest-ProjectReaderTests-895699407 None] Creating offline snapshot 91a31b48-1dac-43e6-9cac-7cac384b9764 of volume 97f1c879-7281-48ae-9776-33bda5797b45 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:23:16 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[07293df8-204e-4c98-aa5f-e3f4deb497a6]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-326875a2-7a02-469c-93d2-fb73b02f3a2c tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:16 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45 Sep 28 16:23:16 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:16 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c.954b25be-2a50-456d-b86f-09fa7b270abb" returned: 0 in 0.384s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-954b25be-2a50-456d-b86f-09fa7b270abb" released by "_delete_snapshot" :: held 2.016s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-78c9f9d8-aa51-464d-bd03-f3754d4ef14c" released by "delete_snapshot" :: held 2.051s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:16 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] Created reservations ['d9cb128e-48cb-4bfb-aa0f-63c7b52c4f0b', '3f7c85c2-2ea2-4381-af61-1ddfec1977a5', '124a13d5-dabd-4d66-b032-cfe73822bbd3', '96c01ca5-fbbd-4904-be18-676540d72b5c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:16 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] Delete snapshot completed successfully. Sep 28 16:23:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-36bf90b5-2899-4982-af1e-0445dd683084 tempest-ProjectMemberTests-462857659 None] Lock "cinder-954b25be-2a50-456d-b86f-09fa7b270abb-delete_snapshot" released by "delete_snapshot" :: held 2.236s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:16 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-326875a2-7a02-469c-93d2-fb73b02f3a2c tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45" returned: 0 in 0.498s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-326875a2-7a02-469c-93d2-fb73b02f3a2c tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:16 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764 1G Sep 28 16:23:16 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:17 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-326875a2-7a02-469c-93d2-fb73b02f3a2c tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764 1G" returned: 0 in 0.528s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-326875a2-7a02-469c-93d2-fb73b02f3a2c tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97f1c879-7281-48ae-9776-33bda5797b45 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:17 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97f1c879-7281-48ae-9776-33bda5797b45 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764 Sep 28 16:23:17 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-155cd5ba-c0d1-453f-8c3c-8ee423c7e431 tempest-ProjectAdminTests-1869651561 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1790084838867, 'free_capacity_gb': 1775.1790084838867, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87087) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 16:23:17 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-326875a2-7a02-469c-93d2-fb73b02f3a2c tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97f1c879-7281-48ae-9776-33bda5797b45 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764" returned: 0 in 0.379s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:17 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-326875a2-7a02-469c-93d2-fb73b02f3a2c tempest-ProjectReaderTests-895699407 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764 is being set with open permissions: ugo+rw Sep 28 16:23:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-326875a2-7a02-469c-93d2-fb73b02f3a2c tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:17 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764 Sep 28 16:23:17 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-78c9f9d8-aa51-464d-bd03-f3754d4ef14c-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] Lock "cinder-78c9f9d8-aa51-464d-bd03-f3754d4ef14c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:17 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=318,cinder:SELECT=215,cinder:INSERT=77,cinder:DELETE=28 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:23:17 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=304,cinder:SELECT=239,cinder:INSERT=84,cinder:DELETE=27 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:23:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-78c9f9d8-aa51-464d-bd03-f3754d4ef14c" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-78c9f9d8-aa51-464d-bd03-f3754d4ef14c" acquired by "delete_volume" :: waited 0.041s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:17 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[34619726-1101-41b2-ba09-9060558b5829]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:17 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-326875a2-7a02-469c-93d2-fb73b02f3a2c tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764" returned: 0 in 0.357s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-326875a2-7a02-469c-93d2-fb73b02f3a2c tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:17 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c Sep 28 16:23:17 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:17 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.info Sep 28 16:23:17 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:18 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c" returned: 0 in 0.543s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:18 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-326875a2-7a02-469c-93d2-fb73b02f3a2c tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.info" returned: 0 in 0.401s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:18 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-326875a2-7a02-469c-93d2-fb73b02f3a2c tempest-ProjectReaderTests-895699407 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.info is being set with open permissions: ugo+rw Sep 28 16:23:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-326875a2-7a02-469c-93d2-fb73b02f3a2c tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:18 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c Sep 28 16:23:18 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:18 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.info Sep 28 16:23:18 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:18 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-78c9f9d8-aa51-464d-bd03-f3754d4ef14c" returned: 0 in 0.298s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-78c9f9d8-aa51-464d-bd03-f3754d4ef14c" released by "delete_volume" :: held 0.932s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:18 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-326875a2-7a02-469c-93d2-fb73b02f3a2c tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.info" returned: 0 in 0.368s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-326875a2-7a02-469c-93d2-fb73b02f3a2c tempest-ProjectReaderTests-895699407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.674s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:18 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] Created reservations ['28e0ab76-1880-408f-9bd3-4c0c6f8e7680', 'f97178f2-56b4-456e-8f88-7573b81c7e65', '9c1e40b3-2809-443d-be29-25e265e77aae', 'df51db04-3502-46fc-ad8a-d5de72e2983e'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:18 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-326875a2-7a02-469c-93d2-fb73b02f3a2c tempest-ProjectReaderTests-895699407 None] Create snapshot completed successfully Sep 28 16:23:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:18 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:18 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:19 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.448s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] Deleted volume successfully. Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-91a31b48-1dac-43e6-9cac-7cac384b9764-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef329e5f-36ce-4cbe-92cc-e991e220a574 tempest-ProjectMemberTests-462857659 None] Lock "cinder-78c9f9d8-aa51-464d-bd03-f3754d4ef14c-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] Lock "cinder-91a31b48-1dac-43e6-9cac-7cac384b9764-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-quobyte-97f1c879-7281-48ae-9776-33bda5797b45" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-97f1c879-7281-48ae-9776-33bda5797b45" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-quobyte-91a31b48-1dac-43e6-9cac-7cac384b9764" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-91a31b48-1dac-43e6-9cac-7cac384b9764" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] Deleting offline snapshot 91a31b48-1dac-43e6-9cac-7cac384b9764 of volume 97f1c879-7281-48ae-9776-33bda5797b45 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] snapshot_file for this snap is: volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[622869a6-5bbb-40e0-ad51-f106f9de3fa7]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Flow 'volume_create_manager' (6715c04c-8b30-4e92-a032-b0f8b4f63341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50a6825-0358-4a73-bda6-966293b7ad78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:19 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764 Sep 28 16:23:19 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50a6825-0358-4a73-bda6-966293b7ad78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-904711917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7450133953dc42bc96e4113d16a5eb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:20Z,use_quota=True,user_id='ffc597531cc541ce8ddc9f6ac2ca8be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a71c2fa-9316-481f-b884-412e5950a75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a71c2fa-9316-481f-b884-412e5950a75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b643dbec-3a9f-4511-93d2-eaa8ef0adeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b643dbec-3a9f-4511-93d2-eaa8ef0adeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa', 'volume_name': 'volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d81e2f-efed-4440-9dfe-df8c48f76846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d81e2f-efed-4440-9dfe-df8c48f76846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8bc373c-226f-41d1-887a-8adae501fd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:19 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Volume 7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa', 'volume_size': 1} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-904711917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7450133953dc42bc96e4113d16a5eb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:20Z,use_quota=True,user_id='ffc597531cc541ce8ddc9f6ac2ca8be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Creating volume 7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:23:19 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:23:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:19 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa 1073741824 Sep 28 16:23:19 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:20 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764" returned: 0 in 0.542s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97f1c879-7281-48ae-9776-33bda5797b45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:23:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[48994e15-ad8e-4043-aa00-3360b69e71ce]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:20 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45 Sep 28 16:23:20 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:20 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa 1073741824" returned: 0 in 0.674s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:20 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa Sep 28 16:23:20 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:20 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45" returned: 0 in 0.552s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:20 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764 Sep 28 16:23:20 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:20 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa" returned: 0 in 0.387s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:23:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8bc373c-226f-41d1-887a-8adae501fd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40dde0c4-82a7-4abd-9bde-1428ac010eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:20 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Volume volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa (7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa): created successfully Sep 28 16:23:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40dde0c4-82a7-4abd-9bde-1428ac010eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Flow 'volume_create_manager' (6715c04c-8b30-4e92-a032-b0f8b4f63341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-73178c63-f4af-4e17-bc9f-6dd494164b7e tempest-ProjectMemberTests-462857659 None] Created volume successfully. Sep 28 16:23:21 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764" returned: 0 in 0.513s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:21 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764 Sep 28 16:23:21 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:21 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45.91a31b48-1dac-43e6-9cac-7cac384b9764" returned: 0 in 0.328s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-91a31b48-1dac-43e6-9cac-7cac384b9764" released by "_delete_snapshot" :: held 2.154s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-97f1c879-7281-48ae-9776-33bda5797b45" released by "delete_snapshot" :: held 2.193s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:21 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] Created reservations ['134ffd4e-dabd-4fa8-8574-df6722adf8d8', 'c7a51778-b097-4769-b0b4-0e54996bb6e4', 'dbcf5c11-77d8-4656-b565-454a3baca9ae', 'b1916419-fed8-47e9-884b-5bc35310417f'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:21 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:23:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Flow 'volume_create_manager' (783a5ee9-81d9-4623-b1b9-51d9997feaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c868d31-ba2d-48bd-ad24-df7bf02f6ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c868d31-ba2d-48bd-ad24-df7bf02f6ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0796a6-db3c-4b25-9049-5368ff2b1fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0ce3f665ed42d9aded6599bf1a2821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:22Z,use_quota=True,user_id='b77ca2675b764609945427f1c1503856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7059dd53-3d62-49e8-9c24-147a4e9f87a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7059dd53-3d62-49e8-9c24-147a4e9f87a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de74d1b-f6ab-4404-bec3-491eee6f782a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:21 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:23:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] Delete snapshot completed successfully. Sep 28 16:23:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-54423eda-6e2b-491e-a8d8-8912899fa3ff tempest-ProjectReaderTests-895699407 None] Lock "cinder-91a31b48-1dac-43e6-9cac-7cac384b9764-delete_snapshot" released by "delete_snapshot" :: held 2.527s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ae346eaa-1dc4-4844-ba32-df631970a56b tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ae346eaa-1dc4-4844-ba32-df631970a56b tempest-ProjectMemberTests-462857659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ae346eaa-1dc4-4844-ba32-df631970a56b tempest-ProjectMemberTests-462857659 None] Creating offline snapshot b20ed2ec-3716-4e07-b735-48e0b15b7a9f of volume 7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e553a26d-341e-401d-9205-7d4b8d0132a2]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae346eaa-1dc4-4844-ba32-df631970a56b tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:22 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa Sep 28 16:23:22 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de74d1b-f6ab-4404-bec3-491eee6f782a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'af0796a6-db3c-4b25-9049-5368ff2b1fbd', 'volume_name': 'volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd', 'volume_size': 1, 'image_id': 'd69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2451b9cb4d9af92ea0805a24e1148832', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2d0ce3f665ed42d9aded6599bf1a2821', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '03e2fc0535d18b8c2cad7f4962b9d5a0237b7d81443821f8ead37868fab188abf27426abbf93ac788cf92e06b35843d569b38a4365acac58c446421851e62ed8', 'id': 'd69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2', 'created_at': datetime.datetime(2026, 9, 28, 14, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 23, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2/file', 'properties': {}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf19b2be-20c6-4fbd-bea8-fff075a99d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf19b2be-20c6-4fbd-bea8-fff075a99d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a038ede-6a41-4427-b148-6177ded9c0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:22 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Volume af0796a6-db3c-4b25-9049-5368ff2b1fbd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd', 'volume_size': 1, 'image_id': 'd69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2451b9cb4d9af92ea0805a24e1148832', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2d0ce3f665ed42d9aded6599bf1a2821', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '03e2fc0535d18b8c2cad7f4962b9d5a0237b7d81443821f8ead37868fab188abf27426abbf93ac788cf92e06b35843d569b38a4365acac58c446421851e62ed8', 'id': 'd69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2', 'created_at': datetime.datetime(2026, 9, 28, 14, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 23, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2/file', 'properties': {}}, 'image_service': } Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Trying to clone af0796a6-db3c-4b25-9049-5368ff2b1fbd from image d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:23:22 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Image download 0.00 MB at 0.00 MB/s Sep 28 16:23:22 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae346eaa-1dc4-4844-ba32-df631970a56b tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa" returned: 0 in 0.439s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae346eaa-1dc4-4844-ba32-df631970a56b tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:22 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f 1G Sep 28 16:23:22 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e097ab8-eb66-4d2d-ae2d-c58282573f06]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-97f1c879-7281-48ae-9776-33bda5797b45-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] Lock "cinder-97f1c879-7281-48ae-9776-33bda5797b45-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:22 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD Sep 28 16:23:22 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-quobyte-97f1c879-7281-48ae-9776-33bda5797b45" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-97f1c879-7281-48ae-9776-33bda5797b45" acquired by "delete_volume" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bca2957-1d7b-478b-aa00-8e15d76f3ade]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:22 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45 Sep 28 16:23:22 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:23 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD" returned: 0 in 0.526s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:23 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae346eaa-1dc4-4844-ba32-df631970a56b tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f 1G" returned: 0 in 0.678s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae346eaa-1dc4-4844-ba32-df631970a56b tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:23 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f Sep 28 16:23:23 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:23 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD Sep 28 16:23:23 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:23 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45" returned: 0 in 0.554s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:23 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45 Sep 28 16:23:23 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:23 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD" returned: 1 in 0.458s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:23:23 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Temporary image d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2 is fetched for user b77ca2675b764609945427f1c1503856. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:23:23 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae346eaa-1dc4-4844-ba32-df631970a56b tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f" returned: 0 in 0.430s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:23 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-ae346eaa-1dc4-4844-ba32-df631970a56b tempest-ProjectMemberTests-462857659 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f is being set with open permissions: ugo+rw Sep 28 16:23:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae346eaa-1dc4-4844-ba32-df631970a56b tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:23 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f Sep 28 16:23:23 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:23 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f332747-9414-4daa-83d1-0c15bb9697ca]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:23 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-97f1c879-7281-48ae-9776-33bda5797b45" returned: 0 in 0.469s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:23 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD Sep 28 16:23:23 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-97f1c879-7281-48ae-9776-33bda5797b45" released by "delete_volume" :: held 1.129s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:24 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae346eaa-1dc4-4844-ba32-df631970a56b tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f" returned: 0 in 0.409s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:24 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] Created reservations ['e75eed1e-6f1c-4d29-b02a-b505a19eb6e4', 'a1bba606-98a0-4626-8876-4d64cc1015a0', '328fabe0-a871-4278-a923-67b38b1619b5', 'c2acb835-1a0f-4955-b5a1-4c4c00bc7734'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae346eaa-1dc4-4844-ba32-df631970a56b tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:24 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.info Sep 28 16:23:24 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:24 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:24 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:24 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD" returned: 0 in 0.648s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:24 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD Sep 28 16:23:24 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:24 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.346s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:24 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] Deleted volume successfully. Sep 28 16:23:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-42b50363-eab0-4de1-830e-afa7f52cdd5e tempest-ProjectReaderTests-895699407 None] Lock "cinder-97f1c879-7281-48ae-9776-33bda5797b45-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:24 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae346eaa-1dc4-4844-ba32-df631970a56b tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.info" returned: 0 in 0.549s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:24 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-ae346eaa-1dc4-4844-ba32-df631970a56b tempest-ProjectMemberTests-462857659 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.info is being set with open permissions: ugo+rw Sep 28 16:23:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae346eaa-1dc4-4844-ba32-df631970a56b tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:24 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.info Sep 28 16:23:24 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:24 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD" returned: 1 in 0.433s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:23:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:25 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae346eaa-1dc4-4844-ba32-df631970a56b tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.info" returned: 0 in 0.325s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ae346eaa-1dc4-4844-ba32-df631970a56b tempest-ProjectMemberTests-462857659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.268s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0796a6-db3c-4b25-9049-5368ff2b1fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0ce3f665ed42d9aded6599bf1a2821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:22Z,use_quota=True,user_id='b77ca2675b764609945427f1c1503856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Creating volume af0796a6-db3c-4b25-9049-5368ff2b1fbd {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:23:25 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:25 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd 1073741824 Sep 28 16:23:25 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:25 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ae346eaa-1dc4-4844-ba32-df631970a56b tempest-ProjectMemberTests-462857659 None] Create snapshot completed successfully Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-b20ed2ec-3716-4e07-b735-48e0b15b7a9f-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] Lock "cinder-b20ed2ec-3716-4e07-b735-48e0b15b7a9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-b20ed2ec-3716-4e07-b735-48e0b15b7a9f" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-b20ed2ec-3716-4e07-b735-48e0b15b7a9f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] Deleting offline snapshot b20ed2ec-3716-4e07-b735-48e0b15b7a9f of volume 7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] snapshot_file for this snap is: volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e11f595-456b-40e9-bb36-5ad56a0e70cb]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:25 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f Sep 28 16:23:25 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Flow 'volume_create_manager' (a1b06404-699c-490d-a4a0-c136559ad2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a01e12-2d61-42c5-b886-2ca137543a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:25 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a01e12-2d61-42c5-b886-2ca137543a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877082354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f971b8b2-ccd3-4c92-89b0-a2d72e16d032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ae7215c3f8d4903b7d7902e311345cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:26Z,use_quota=True,user_id='397c066939cd4186859cbc90175a4a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9210b35-1676-484d-ad86-4cd75373b14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9210b35-1676-484d-ad86-4cd75373b14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f227face-eb70-4694-b28f-83562f9eda47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f227face-eb70-4694-b28f-83562f9eda47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f971b8b2-ccd3-4c92-89b0-a2d72e16d032', 'volume_name': 'volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c331350-da5a-4fa1-8c7d-8c53d92def28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c331350-da5a-4fa1-8c7d-8c53d92def28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48586e5-3198-43b4-869c-4cf8bd2ff742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:25 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Volume f971b8b2-ccd3-4c92-89b0-a2d72e16d032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032', 'volume_size': 1} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd 1073741824" returned: 0 in 0.827s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:25 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd Sep 28 16:23:25 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:26 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f" returned: 0 in 0.567s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1526a67-4ead-4ebc-aa2b-8a34d8bef53b]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:26 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa Sep 28 16:23:26 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:26 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd" returned: 0 in 0.358s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.408s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877082354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f971b8b2-ccd3-4c92-89b0-a2d72e16d032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ae7215c3f8d4903b7d7902e311345cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:26Z,use_quota=True,user_id='397c066939cd4186859cbc90175a4a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Creating volume f971b8b2-ccd3-4c92-89b0-a2d72e16d032 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:23:26 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:26 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032 1073741824 Sep 28 16:23:26 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Attempting download of d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2 ((None, [{'url': 'file:///opt/stack/data/glance/images/d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2', 'metadata': {}}])) to volume af0796a6-db3c-4b25-9049-5368ff2b1fbd. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d296e0-6e0c-444b-8ffc-785829bd1f05]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_sks7ku19 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:26 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_sks7ku19 Sep 28 16:23:26 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:26 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa" returned: 0 in 0.577s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:26 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f Sep 28 16:23:26 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:27 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_sks7ku19" returned: 0 in 0.578s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_sks7ku19 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:27 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032 1073741824" returned: 0 in 0.753s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:27 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:27 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032 Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f" returned: 0 in 0.489s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:27 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:27 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_sks7ku19 Sep 28 16:23:27 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:27 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f Sep 28 16:23:27 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:27 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa.b20ed2ec-3716-4e07-b735-48e0b15b7a9f" returned: 0 in 0.309s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:27 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032" returned: 0 in 0.394s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-b20ed2ec-3716-4e07-b735-48e0b15b7a9f" released by "_delete_snapshot" :: held 2.127s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:27 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_sks7ku19" returned: 1 in 0.507s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_sks7ku19' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[351e6125-31e2-4cd5-9db6-cf4229937bb8]: (4, 'raw') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa" released by "delete_snapshot" :: held 2.178s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48586e5-3198-43b4-869c-4cf8bd2ff742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4699ac06-4189-4821-b5e4-d49e7ab7c1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:27 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Volume volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032 (f971b8b2-ccd3-4c92-89b0-a2d72e16d032): created successfully Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4699ac06-4189-4821-b5e4-d49e7ab7c1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Flow 'volume_create_manager' (a1b06404-699c-490d-a4a0-c136559ad2d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e904adf3-1312-4435-be3f-ad7d3092ad2a tempest-ProjectReaderTests-895699407 None] Created volume successfully. Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] Created reservations ['e879f5d1-1999-4741-a77a-c610ed257f56', '69972949-da35-4cf8-8238-0e5fd88ed3e3', '46168325-5417-4360-849f-f4e2eeeab8db', '27044268-25a4-429b-9926-c40d3d7fd995'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:27 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD Sep 28 16:23:27 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] Delete snapshot completed successfully. Sep 28 16:23:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1699eda7-28dc-490f-9c31-d4c64320ef3d tempest-ProjectMemberTests-462857659 None] Lock "cinder-b20ed2ec-3716-4e07-b735-48e0b15b7a9f-delete_snapshot" released by "delete_snapshot" :: held 2.448s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:28 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD" returned: 0 in 0.482s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1c1b3a9a-1706-4b3e-9342-5f7c621d29cf tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1c1b3a9a-1706-4b3e-9342-5f7c621d29cf tempest-ProjectReaderTests-895699407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:28 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD Sep 28 16:23:28 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1c1b3a9a-1706-4b3e-9342-5f7c621d29cf tempest-ProjectReaderTests-895699407 None] Creating offline snapshot 31f91e4b-2c3a-4047-8002-d9fa3946dc83 of volume f971b8b2-ccd3-4c92-89b0-a2d72e16d032 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:23:28 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf8ab6e-d6a0-4942-8f48-437fac68e7c6]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c1b3a9a-1706-4b3e-9342-5f7c621d29cf tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:28 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032 Sep 28 16:23:28 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:28 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD" returned: 1 in 0.457s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:23:28 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2 was raw, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:23:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:28 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd Sep 28 16:23:28 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] Lock "cinder-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:28 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c1b3a9a-1706-4b3e-9342-5f7c621d29cf tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032" returned: 0 in 0.565s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c1b3a9a-1706-4b3e-9342-5f7c621d29cf tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:28 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83 1G Sep 28 16:23:28 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:28 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[580a6a48-2e9c-4b38-946c-187ceb58c2f7]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:29 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa Sep 28 16:23:29 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:29 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd" returned: 0 in 0.729s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:29 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2_3t_5i73qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:23:29 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 16:23:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:29 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd 1G Sep 28 16:23:29 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:29 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c1b3a9a-1706-4b3e-9342-5f7c621d29cf tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83 1G" returned: 0 in 0.594s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c1b3a9a-1706-4b3e-9342-5f7c621d29cf tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:29 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83 Sep 28 16:23:29 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:29 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa" returned: 0 in 0.490s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:29 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa Sep 28 16:23:29 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:29 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd 1G" returned: 0 in 0.394s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:29 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Downloaded image d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2 ((None, [{'url': 'file:///opt/stack/data/glance/images/d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2', 'metadata': {}}])) to volume af0796a6-db3c-4b25-9049-5368ff2b1fbd successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:23:29 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Temporary image d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2 for user b77ca2675b764609945427f1c1503856 is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:23:29 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Marking volume af0796a6-db3c-4b25-9049-5368ff2b1fbd as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:23:29 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa" returned: 0 in 0.271s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:29 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa" released by "delete_volume" :: held 0.847s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c1b3a9a-1706-4b3e-9342-5f7c621d29cf tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83" returned: 0 in 0.374s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:29 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-1c1b3a9a-1706-4b3e-9342-5f7c621d29cf tempest-ProjectReaderTests-895699407 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83 is being set with open permissions: ugo+rw Sep 28 16:23:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c1b3a9a-1706-4b3e-9342-5f7c621d29cf tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:29 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83 Sep 28 16:23:29 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:30 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c1b3a9a-1706-4b3e-9342-5f7c621d29cf tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83" returned: 0 in 0.273s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:30 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Copying metadata from image d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2 to af0796a6-db3c-4b25-9049-5368ff2b1fbd. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:23:30 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Creating volume glance metadata for volume af0796a6-db3c-4b25-9049-5368ff2b1fbd backed by image d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2 with: {'image_id': 'd69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2451b9cb4d9af92ea0805a24e1148832', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:23:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c1b3a9a-1706-4b3e-9342-5f7c621d29cf tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:30 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.info Sep 28 16:23:30 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:30 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] Created reservations ['589728a6-73c6-4df8-8b9f-aca1a171704e', 'bfcbae92-98d4-4254-aeaf-77476fa7befa', 'a2a2ef09-6500-4a9e-8c7f-63dab274ee88', '31fbb821-db90-43b7-9e01-e05c10c2d72c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:31 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c1b3a9a-1706-4b3e-9342-5f7c621d29cf tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.info" returned: 0 in 0.269s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:31 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-1c1b3a9a-1706-4b3e-9342-5f7c621d29cf tempest-ProjectReaderTests-895699407 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.info is being set with open permissions: ugo+rw Sep 28 16:23:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c1b3a9a-1706-4b3e-9342-5f7c621d29cf tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:31 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.info Sep 28 16:23:31 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:31 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c1b3a9a-1706-4b3e-9342-5f7c621d29cf tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.info" returned: 0 in 0.237s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1c1b3a9a-1706-4b3e-9342-5f7c621d29cf tempest-ProjectReaderTests-895699407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.169s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a038ede-6a41-4427-b148-6177ded9c0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd', 'volume_size': 1, 'image_id': 'd69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2451b9cb4d9af92ea0805a24e1148832', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2d0ce3f665ed42d9aded6599bf1a2821', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '03e2fc0535d18b8c2cad7f4962b9d5a0237b7d81443821f8ead37868fab188abf27426abbf93ac788cf92e06b35843d569b38a4365acac58c446421851e62ed8', 'id': 'd69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2', 'created_at': datetime.datetime(2026, 9, 28, 14, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 23, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d69bbbf6-f0f7-40de-a8fb-2e1fa2b6bac2/file', 'properties': {}}, 'image_service': }' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db853cf-6063-409a-b370-b7d0a1514f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:31 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1c1b3a9a-1706-4b3e-9342-5f7c621d29cf tempest-ProjectReaderTests-895699407 None] Create snapshot completed successfully Sep 28 16:23:32 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Volume volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd (af0796a6-db3c-4b25-9049-5368ff2b1fbd): created successfully Sep 28 16:23:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db853cf-6063-409a-b370-b7d0a1514f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Flow 'volume_create_manager' (783a5ee9-81d9-4623-b1b9-51d9997feaf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:32 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:32 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:32 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.252s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:32 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:32 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] Deleted volume successfully. Sep 28 16:23:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-97a92ea7-8f5c-4835-9a4c-1f47b8aa794f tempest-VolumeImageDependencyTests-61936903 None] Created volume successfully. Sep 28 16:23:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-31f91e4b-2c3a-4047-8002-d9fa3946dc83-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-44e64c10-d123-475d-9895-e1d403a59916 tempest-ProjectMemberTests-462857659 None] Lock "cinder-7b11e6b8-a8f8-4525-ac73-7ad5a08f64fa-delete_volume" released by "delete_volume" :: held 4.830s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] Lock "cinder-31f91e4b-2c3a-4047-8002-d9fa3946dc83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-quobyte-f971b8b2-ccd3-4c92-89b0-a2d72e16d032" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-f971b8b2-ccd3-4c92-89b0-a2d72e16d032" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-quobyte-31f91e4b-2c3a-4047-8002-d9fa3946dc83" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-31f91e4b-2c3a-4047-8002-d9fa3946dc83" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] Deleting offline snapshot 31f91e4b-2c3a-4047-8002-d9fa3946dc83 of volume f971b8b2-ccd3-4c92-89b0-a2d72e16d032 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:23:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] snapshot_file for this snap is: volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:23:33 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdb9f19-12d3-4f3b-bb20-88106fc9af29]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:33 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83 Sep 28 16:23:33 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:34 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83" returned: 0 in 0.370s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:23:34 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b90768-a719-4cdd-ad9c-59f035a23407]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:34 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032 Sep 28 16:23:34 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:34 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032" returned: 0 in 0.361s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:34 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83 Sep 28 16:23:34 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:34 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83" returned: 0 in 0.331s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:34 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83 Sep 28 16:23:34 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:34 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032.31f91e4b-2c3a-4047-8002-d9fa3946dc83" returned: 0 in 0.236s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-31f91e4b-2c3a-4047-8002-d9fa3946dc83" released by "_delete_snapshot" :: held 1.408s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-f971b8b2-ccd3-4c92-89b0-a2d72e16d032" released by "delete_snapshot" :: held 1.431s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:35 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:35 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:35 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.255s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] Created reservations ['be7579d7-e3e9-4f62-9d37-53e98278b937', '65f75979-98d4-444e-b73d-c2b585b7f659', '117cc9a0-7f1c-41e8-890d-22e1607499c2', '262d7324-8d4c-40ed-b82a-662b1cf74b17'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] Acquiring lock "cinder-af0796a6-db3c-4b25-9049-5368ff2b1fbd-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] Lock "cinder-af0796a6-db3c-4b25-9049-5368ff2b1fbd-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] Acquiring lock "cinder-quobyte-af0796a6-db3c-4b25-9049-5368ff2b1fbd" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] Lock "cinder-quobyte-af0796a6-db3c-4b25-9049-5368ff2b1fbd" acquired by "delete_volume" :: waited 0.043s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:35 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] Delete snapshot completed successfully. Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1111260-041b-4b97-9ed4-43f9c6eb3f96 tempest-ProjectReaderTests-895699407 None] Lock "cinder-31f91e4b-2c3a-4047-8002-d9fa3946dc83-delete_snapshot" released by "delete_snapshot" :: held 2.302s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[205de89b-1fa4-42ed-b7c8-83482cf3f079]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Flow 'volume_create_manager' (382d8ffb-d55f-4c37-95e6-7530261ca563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:36 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae7a1c9-d332-45d1-bb76-da64bccc1b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:36 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae7a1c9-d332-45d1-bb76-da64bccc1b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2029025539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6d6b6d-a68b-4767-b677-f374ceafa576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7450133953dc42bc96e4113d16a5eb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:36Z,use_quota=True,user_id='ffc597531cc541ce8ddc9f6ac2ca8be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b697e6e5-3c93-4cbb-b8cb-6ca40cae60c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b697e6e5-3c93-4cbb-b8cb-6ca40cae60c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5ee552-671e-4f7d-a770-fa7818a51132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5ee552-671e-4f7d-a770-fa7818a51132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c6d6b6d-a68b-4767-b677-f374ceafa576', 'volume_name': 'volume-6c6d6b6d-a68b-4767-b677-f374ceafa576', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7794aeb-61ea-49c4-8fe9-bfdabbfc61eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7794aeb-61ea-49c4-8fe9-bfdabbfc61eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091b4f5b-59fd-4e2b-a6bb-f36aa98fffe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:36 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Volume 6c6d6b6d-a68b-4767-b677-f374ceafa576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c6d6b6d-a68b-4767-b677-f374ceafa576', 'volume_size': 1} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2029025539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6d6b6d-a68b-4767-b677-f374ceafa576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7450133953dc42bc96e4113d16a5eb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:36Z,use_quota=True,user_id='ffc597531cc541ce8ddc9f6ac2ca8be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Creating volume 6c6d6b6d-a68b-4767-b677-f374ceafa576 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:23:36 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:36 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576 1073741824 Sep 28 16:23:36 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:36 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd" returned: 0 in 0.544s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:36 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd Sep 28 16:23:36 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:36 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576 1073741824" returned: 0 in 0.664s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:36 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-f971b8b2-ccd3-4c92-89b0-a2d72e16d032-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-af0796a6-db3c-4b25-9049-5368ff2b1fbd" returned: 0 in 0.476s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] Lock "cinder-quobyte-af0796a6-db3c-4b25-9049-5368ff2b1fbd" released by "delete_volume" :: held 1.133s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] Lock "cinder-f971b8b2-ccd3-4c92-89b0-a2d72e16d032-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-quobyte-f971b8b2-ccd3-4c92-89b0-a2d72e16d032" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:37 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576 Sep 28 16:23:37 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-f971b8b2-ccd3-4c92-89b0-a2d72e16d032" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] Created reservations ['081d3e4c-3dec-4de9-9723-1819245a2862', '33793ed6-17b6-4f2c-b4eb-d1f514e4de16', 'cbda4072-2b25-434e-8876-9339a24290ba', 'ef879aad-7f42-446c-96ae-a85d36e44fe9'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d11ef18-589e-4a88-a20d-f13934c72482]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:37 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:37 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:37 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032 Sep 28 16:23:37 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:37 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576" returned: 0 in 0.354s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091b4f5b-59fd-4e2b-a6bb-f36aa98fffe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c6d6b6d-a68b-4767-b677-f374ceafa576', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20a07e21-76a5-4414-9e24-1551f5384154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:37 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Volume volume-6c6d6b6d-a68b-4767-b677-f374ceafa576 (6c6d6b6d-a68b-4767-b677-f374ceafa576): created successfully Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20a07e21-76a5-4414-9e24-1551f5384154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Flow 'volume_create_manager' (382d8ffb-d55f-4c37-95e6-7530261ca563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b80817a6-5030-42cf-afc5-6ed3c9dfdbbc tempest-ProjectMemberTests-462857659 None] Created volume successfully. Sep 28 16:23:37 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.334s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] Deleted volume successfully. Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0dd81ff2-cc73-4ce8-869e-868f859aa51b tempest-VolumeImageDependencyTests-61936903 None] Lock "cinder-af0796a6-db3c-4b25-9049-5368ff2b1fbd-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:37 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032" returned: 0 in 0.558s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:37 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032 Sep 28 16:23:37 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:38 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-f971b8b2-ccd3-4c92-89b0-a2d72e16d032" returned: 0 in 0.356s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-f971b8b2-ccd3-4c92-89b0-a2d72e16d032" released by "delete_volume" :: held 1.041s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:38 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] Created reservations ['e04e9c27-dea5-44d1-80be-d6572b7d9bdf', '078e106b-2659-472f-89e8-5627127fa558', '62516db6-8a8b-4c39-95e4-829b8de3e67f', '54a149c1-7337-45a9-aa91-3cace2709112'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:38 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:38 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-946a52d2-a9bb-4e9e-8ecd-21595de4e307 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-946a52d2-a9bb-4e9e-8ecd-21595de4e307 tempest-ProjectMemberTests-462857659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-946a52d2-a9bb-4e9e-8ecd-21595de4e307 tempest-ProjectMemberTests-462857659 None] Creating offline snapshot 7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928 of volume 6c6d6b6d-a68b-4767-b677-f374ceafa576 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:23:38 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[43daaa5f-1ee7-40ad-8d99-974016e96105]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-946a52d2-a9bb-4e9e-8ecd-21595de4e307 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:38 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576 Sep 28 16:23:38 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:38 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.449s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:38 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:38 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] Deleted volume successfully. Sep 28 16:23:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-593eb03f-d426-4d30-b8a6-ef286fb779de tempest-ProjectReaderTests-895699407 None] Lock "cinder-f971b8b2-ccd3-4c92-89b0-a2d72e16d032-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:39 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-946a52d2-a9bb-4e9e-8ecd-21595de4e307 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576" returned: 0 in 0.502s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-946a52d2-a9bb-4e9e-8ecd-21595de4e307 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:39 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928 1G Sep 28 16:23:39 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:39 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-946a52d2-a9bb-4e9e-8ecd-21595de4e307 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928 1G" returned: 0 in 0.808s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-946a52d2-a9bb-4e9e-8ecd-21595de4e307 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c6d6b6d-a68b-4767-b677-f374ceafa576 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:39 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c6d6b6d-a68b-4767-b677-f374ceafa576 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928 Sep 28 16:23:39 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:40 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:23:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Flow 'volume_create_manager' (4434af3a-0f3b-4057-b34e-fc6c93bc313f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9545ca71-b897-46a0-996e-48eeb5d8df95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9545ca71-b897-46a0-996e-48eeb5d8df95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1273828012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05bbf30-7eae-4041-93cb-5e44911a0666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ae7215c3f8d4903b7d7902e311345cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:40Z,use_quota=True,user_id='397c066939cd4186859cbc90175a4a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51004db-2098-4084-ad1c-480d521550cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51004db-2098-4084-ad1c-480d521550cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44944a06-63a3-4e4b-8593-34a84c29fec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44944a06-63a3-4e4b-8593-34a84c29fec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b05bbf30-7eae-4041-93cb-5e44911a0666', 'volume_name': 'volume-b05bbf30-7eae-4041-93cb-5e44911a0666', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf6a965-450d-4427-9620-2101b7d5359c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf6a965-450d-4427-9620-2101b7d5359c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05d194e-35ab-4fa6-9f39-01391a76449f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:40 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Volume b05bbf30-7eae-4041-93cb-5e44911a0666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b05bbf30-7eae-4041-93cb-5e44911a0666', 'volume_size': 1} Sep 28 16:23:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:40 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-946a52d2-a9bb-4e9e-8ecd-21595de4e307 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c6d6b6d-a68b-4767-b677-f374ceafa576 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928" returned: 0 in 0.398s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:40 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-946a52d2-a9bb-4e9e-8ecd-21595de4e307 tempest-ProjectMemberTests-462857659 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928 is being set with open permissions: ugo+rw Sep 28 16:23:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-946a52d2-a9bb-4e9e-8ecd-21595de4e307 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:40 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928 Sep 28 16:23:40 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:40 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-946a52d2-a9bb-4e9e-8ecd-21595de4e307 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928" returned: 0 in 0.318s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-946a52d2-a9bb-4e9e-8ecd-21595de4e307 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:40 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.info Sep 28 16:23:40 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:40 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-946a52d2-a9bb-4e9e-8ecd-21595de4e307 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.info" returned: 0 in 0.329s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:40 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-946a52d2-a9bb-4e9e-8ecd-21595de4e307 tempest-ProjectMemberTests-462857659 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.info is being set with open permissions: ugo+rw Sep 28 16:23:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-946a52d2-a9bb-4e9e-8ecd-21595de4e307 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:41 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.info Sep 28 16:23:41 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:41 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-946a52d2-a9bb-4e9e-8ecd-21595de4e307 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.info" returned: 0 in 0.264s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-946a52d2-a9bb-4e9e-8ecd-21595de4e307 tempest-ProjectMemberTests-462857659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.775s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.179s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1273828012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05bbf30-7eae-4041-93cb-5e44911a0666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ae7215c3f8d4903b7d7902e311345cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:40Z,use_quota=True,user_id='397c066939cd4186859cbc90175a4a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Creating volume b05bbf30-7eae-4041-93cb-5e44911a0666 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:23:41 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:41 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666 1073741824 Sep 28 16:23:41 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:41 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-946a52d2-a9bb-4e9e-8ecd-21595de4e307 tempest-ProjectMemberTests-462857659 None] Create snapshot completed successfully Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] Lock "cinder-7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-6c6d6b6d-a68b-4767-b677-f374ceafa576" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-6c6d6b6d-a68b-4767-b677-f374ceafa576" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] Deleting offline snapshot 7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928 of volume 6c6d6b6d-a68b-4767-b677-f374ceafa576 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] snapshot_file for this snap is: volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a52dfe-50d6-4aff-b45a-b1a4ce18f59c]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:41 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666 1073741824" returned: 0 in 0.704s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:42 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928 Sep 28 16:23:42 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:42 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666 Sep 28 16:23:42 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:42 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666" returned: 0 in 0.315s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05d194e-35ab-4fa6-9f39-01391a76449f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b05bbf30-7eae-4041-93cb-5e44911a0666', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:42 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f5faf5-869c-4800-be10-6ed3a1ac19dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928" returned: 0 in 0.522s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c6d6b6d-a68b-4767-b677-f374ceafa576(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:23:42 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Volume volume-b05bbf30-7eae-4041-93cb-5e44911a0666 (b05bbf30-7eae-4041-93cb-5e44911a0666): created successfully Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f5faf5-869c-4800-be10-6ed3a1ac19dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Flow 'volume_create_manager' (4434af3a-0f3b-4057-b34e-fc6c93bc313f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b0cc45-8378-4636-98a6-60014ddc9bb6]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-34919749-5874-42a8-9468-609ce0032cb0 tempest-ProjectReaderTests-895699407 None] Created volume successfully. Sep 28 16:23:42 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576 Sep 28 16:23:42 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Flow 'volume_create_manager' (50ef1ddb-4b0f-4a27-a157-b7c70e8202ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e066b39-9f42-42d3-aa8a-3bdc26f06501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e066b39-9f42-42d3-aa8a-3bdc26f06501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-967869194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58ac531-cdd3-424c-af26-5b6af58ede3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fadbdc23b6db486595fdfad601f85d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:43Z,use_quota=True,user_id='ef890231fcff4e7ea3802d7c723888fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5660ed2e-c0b6-4d1e-9ba3-c9b6e0c9750a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5660ed2e-c0b6-4d1e-9ba3-c9b6e0c9750a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1b776a-9790-4f55-ad0a-f44d8b22c041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1b776a-9790-4f55-ad0a-f44d8b22c041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e58ac531-cdd3-424c-af26-5b6af58ede3f', 'volume_name': 'volume-e58ac531-cdd3-424c-af26-5b6af58ede3f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9ce674-d84d-492f-b8a8-0f9327f76f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9ce674-d84d-492f-b8a8-0f9327f76f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29421a1-7227-44d0-a8d3-4274e3715058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:42 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Volume e58ac531-cdd3-424c-af26-5b6af58ede3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e58ac531-cdd3-424c-af26-5b6af58ede3f', 'volume_size': 1} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-967869194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58ac531-cdd3-424c-af26-5b6af58ede3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fadbdc23b6db486595fdfad601f85d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:43Z,use_quota=True,user_id='ef890231fcff4e7ea3802d7c723888fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Creating volume e58ac531-cdd3-424c-af26-5b6af58ede3f {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:23:42 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e58ac531-cdd3-424c-af26-5b6af58ede3f 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:42 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e58ac531-cdd3-424c-af26-5b6af58ede3f 1073741824 Sep 28 16:23:42 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:42 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576" returned: 0 in 0.486s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:42 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928 Sep 28 16:23:42 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0c4367f4-df83-466b-9d75-ac40e58cfbf8 tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:43 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928" returned: 0 in 0.530s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:43 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e58ac531-cdd3-424c-af26-5b6af58ede3f 1073741824" returned: 0 in 0.640s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:43 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928 Sep 28 16:23:43 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e58ac531-cdd3-424c-af26-5b6af58ede3f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:43 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e58ac531-cdd3-424c-af26-5b6af58ede3f Sep 28 16:23:43 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:43 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576.7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928" returned: 0 in 0.369s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928" released by "_delete_snapshot" :: held 2.061s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-6c6d6b6d-a68b-4767-b677-f374ceafa576" released by "delete_snapshot" :: held 2.092s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:43 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e58ac531-cdd3-424c-af26-5b6af58ede3f" returned: 0 in 0.341s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:23:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0c4367f4-df83-466b-9d75-ac40e58cfbf8 tempest-ProjectReaderTests-895699407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.503s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29421a1-7227-44d0-a8d3-4274e3715058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e58ac531-cdd3-424c-af26-5b6af58ede3f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8378a742-83be-4a72-b686-8fb59c0f7b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-0c4367f4-df83-466b-9d75-ac40e58cfbf8 tempest-ProjectReaderTests-895699407 None] Creating offline snapshot 7945f17a-ecdb-4c47-b7d6-913c23e96125 of volume b05bbf30-7eae-4041-93cb-5e44911a0666 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:23:43 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbad2b97-f92f-4699-8b61-85e17d37921f]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0c4367f4-df83-466b-9d75-ac40e58cfbf8 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:44 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Volume volume-e58ac531-cdd3-424c-af26-5b6af58ede3f (e58ac531-cdd3-424c-af26-5b6af58ede3f): created successfully Sep 28 16:23:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8378a742-83be-4a72-b686-8fb59c0f7b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Flow 'volume_create_manager' (50ef1ddb-4b0f-4a27-a157-b7c70e8202ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:44 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] Created reservations ['d867b98c-2b5b-4bb2-9dbc-a7c324964348', '2675ae47-586d-49ea-9571-777b69b95821', '53bc980a-8d71-43be-ac92-f30e6fb2e21a', '7c692267-3689-4c0a-a69b-ac02643755b8'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:44 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c85b98ca-a08a-4228-8f7f-5f3df8b27073 tempest-ProjectReaderTests-1510768602 None] Created volume successfully. Sep 28 16:23:44 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666 Sep 28 16:23:44 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:44 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] Delete snapshot completed successfully. Sep 28 16:23:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34bdd60b-5355-4fe7-be9c-6b0b344f1ea3 tempest-ProjectMemberTests-462857659 None] Lock "cinder-7d28c0d7-74ea-4d72-b6ca-bb6d88c0d928-delete_snapshot" released by "delete_snapshot" :: held 2.464s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:44 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0c4367f4-df83-466b-9d75-ac40e58cfbf8 tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666" returned: 0 in 0.523s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0c4367f4-df83-466b-9d75-ac40e58cfbf8 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:44 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125 1G Sep 28 16:23:44 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-6c6d6b6d-a68b-4767-b677-f374ceafa576-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] Lock "cinder-6c6d6b6d-a68b-4767-b677-f374ceafa576-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-6c6d6b6d-a68b-4767-b677-f374ceafa576" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] Acquiring lock "cinder-e58ac531-cdd3-424c-af26-5b6af58ede3f-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:45 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0c4367f4-df83-466b-9d75-ac40e58cfbf8 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125 1G" returned: 0 in 0.655s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0c4367f4-df83-466b-9d75-ac40e58cfbf8 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b05bbf30-7eae-4041-93cb-5e44911a0666 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-6c6d6b6d-a68b-4767-b677-f374ceafa576" acquired by "delete_volume" :: waited 0.056s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:45 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b05bbf30-7eae-4041-93cb-5e44911a0666 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125 Sep 28 16:23:45 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] Lock "cinder-e58ac531-cdd3-424c-af26-5b6af58ede3f-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0b1510-7fb0-4eac-99d6-ff8dc9b1609e]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] Acquiring lock "cinder-quobyte-e58ac531-cdd3-424c-af26-5b6af58ede3f" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] Lock "cinder-quobyte-e58ac531-cdd3-424c-af26-5b6af58ede3f" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fffe2a-4927-4571-8a2c-be0d7c557a64]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e58ac531-cdd3-424c-af26-5b6af58ede3f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:45 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576 Sep 28 16:23:45 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:45 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e58ac531-cdd3-424c-af26-5b6af58ede3f Sep 28 16:23:45 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:45 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0c4367f4-df83-466b-9d75-ac40e58cfbf8 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b05bbf30-7eae-4041-93cb-5e44911a0666 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125" returned: 0 in 0.460s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:45 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-0c4367f4-df83-466b-9d75-ac40e58cfbf8 tempest-ProjectReaderTests-895699407 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125 is being set with open permissions: ugo+rw Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0c4367f4-df83-466b-9d75-ac40e58cfbf8 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:45 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125 Sep 28 16:23:45 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:45 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576" returned: 0 in 0.541s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:45 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576 Sep 28 16:23:45 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:45 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e58ac531-cdd3-424c-af26-5b6af58ede3f" returned: 0 in 0.530s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e58ac531-cdd3-424c-af26-5b6af58ede3f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:45 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e58ac531-cdd3-424c-af26-5b6af58ede3f Sep 28 16:23:45 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:46 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0c4367f4-df83-466b-9d75-ac40e58cfbf8 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125" returned: 0 in 0.372s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0c4367f4-df83-466b-9d75-ac40e58cfbf8 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:46 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.info Sep 28 16:23:46 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:46 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-6c6d6b6d-a68b-4767-b677-f374ceafa576" returned: 0 in 0.434s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-6c6d6b6d-a68b-4767-b677-f374ceafa576" released by "delete_volume" :: held 1.114s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] Created reservations ['73b7083c-7b60-417c-b8b6-c23bc5f71662', '052b5040-1025-43ab-8ade-f9444bdd8d03', '8c581f59-baad-4caf-84bc-239705744067', '7908d129-fa78-4ee2-9559-5be9ab222324'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:46 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e58ac531-cdd3-424c-af26-5b6af58ede3f" returned: 0 in 0.448s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] Lock "cinder-quobyte-e58ac531-cdd3-424c-af26-5b6af58ede3f" released by "delete_volume" :: held 1.044s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:46 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0c4367f4-df83-466b-9d75-ac40e58cfbf8 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.info" returned: 0 in 0.418s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:46 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-0c4367f4-df83-466b-9d75-ac40e58cfbf8 tempest-ProjectReaderTests-895699407 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.info is being set with open permissions: ugo+rw Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0c4367f4-df83-466b-9d75-ac40e58cfbf8 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:46 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.info Sep 28 16:23:46 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] Created reservations ['8a8422af-702f-47f0-a8a4-48d7f3babe24', '785a3cc3-7768-4476-9c06-b26365801dc7', 'b487232e-2c6c-44c7-bef3-a6d252c0987f', '52041390-bf16-47ff-a7af-6e1dc893d809'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:46 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:46 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:46 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:46 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:46 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0c4367f4-df83-466b-9d75-ac40e58cfbf8 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.info" returned: 0 in 0.336s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0c4367f4-df83-466b-9d75-ac40e58cfbf8 tempest-ProjectReaderTests-895699407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.900s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:46 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0c4367f4-df83-466b-9d75-ac40e58cfbf8 tempest-ProjectReaderTests-895699407 None] Create snapshot completed successfully Sep 28 16:23:46 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.361s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:46 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] Deleted volume successfully. Sep 28 16:23:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d48174c-be57-497c-8aeb-eb6c755e5e3d tempest-ProjectMemberTests-462857659 None] Lock "cinder-6c6d6b6d-a68b-4767-b677-f374ceafa576-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:47 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.322s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:47 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] Deleted volume successfully. Sep 28 16:23:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-255a146d-9ede-48a5-b44b-7bd96c8816fe tempest-ProjectReaderTests-1510768602 None] Lock "cinder-e58ac531-cdd3-424c-af26-5b6af58ede3f-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-7945f17a-ecdb-4c47-b7d6-913c23e96125-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] Lock "cinder-7945f17a-ecdb-4c47-b7d6-913c23e96125-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-quobyte-b05bbf30-7eae-4041-93cb-5e44911a0666" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-b05bbf30-7eae-4041-93cb-5e44911a0666" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-quobyte-7945f17a-ecdb-4c47-b7d6-913c23e96125" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-7945f17a-ecdb-4c47-b7d6-913c23e96125" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] Deleting offline snapshot 7945f17a-ecdb-4c47-b7d6-913c23e96125 of volume b05bbf30-7eae-4041-93cb-5e44911a0666 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] snapshot_file for this snap is: volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a27b5a-a8fc-4d6d-b4e6-a53e017eb31b]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Flow 'volume_create_manager' (37a0038d-f012-4a9c-8cb0-681b5e89a7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe43dae-b106-461f-a117-c9a436ddc553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:48 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125 Sep 28 16:23:48 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe43dae-b106-461f-a117-c9a436ddc553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-741358587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d1997ca-673f-4b3c-9219-72b2a5b2cd7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7450133953dc42bc96e4113d16a5eb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:48Z,use_quota=True,user_id='ffc597531cc541ce8ddc9f6ac2ca8be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73909962-6831-4ab6-b491-fce7d98319ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73909962-6831-4ab6-b491-fce7d98319ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc107552-197c-4a96-98f7-d4b41c2e9483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc107552-197c-4a96-98f7-d4b41c2e9483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d1997ca-673f-4b3c-9219-72b2a5b2cd7e', 'volume_name': 'volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d98172e1-7ff4-497d-941e-380087a4c884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d98172e1-7ff4-497d-941e-380087a4c884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6c8d7a-c159-40a3-9d22-262698cb4115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:48 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Volume 3d1997ca-673f-4b3c-9219-72b2a5b2cd7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e', 'volume_size': 1} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-741358587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d1997ca-673f-4b3c-9219-72b2a5b2cd7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7450133953dc42bc96e4113d16a5eb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:48Z,use_quota=True,user_id='ffc597531cc541ce8ddc9f6ac2ca8be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Creating volume 3d1997ca-673f-4b3c-9219-72b2a5b2cd7e {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:23:48 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:48 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e 1073741824 Sep 28 16:23:48 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Flow 'volume_create_manager' (342e5e66-8c4e-41a7-9330-0d0dda39634d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84866cf9-d9c2-4f8a-acc8-97d70f749822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84866cf9-d9c2-4f8a-acc8-97d70f749822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-816330980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c389c6-a6fc-48c7-aa20-137cfe62df9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fadbdc23b6db486595fdfad601f85d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:48Z,use_quota=True,user_id='ef890231fcff4e7ea3802d7c723888fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86abd59c-4b20-41ac-8b4c-61f0b4b511ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86abd59c-4b20-41ac-8b4c-61f0b4b511ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0a6315-3166-439c-854c-b583f800bbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0a6315-3166-439c-854c-b583f800bbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25c389c6-a6fc-48c7-aa20-137cfe62df9d', 'volume_name': 'volume-25c389c6-a6fc-48c7-aa20-137cfe62df9d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd3d631-af22-4157-b975-d6b7c6e931dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd3d631-af22-4157-b975-d6b7c6e931dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8d5ed6-4748-44ee-bc47-ff08ffbf5b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:48 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Volume 25c389c6-a6fc-48c7-aa20-137cfe62df9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25c389c6-a6fc-48c7-aa20-137cfe62df9d', 'volume_size': 1} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:48 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125" returned: 0 in 0.522s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b05bbf30-7eae-4041-93cb-5e44911a0666(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc08c2d5-3618-4311-8881-5cae23524d01]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:48 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666 Sep 28 16:23:48 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:48 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e 1073741824" returned: 0 in 0.504s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:48 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e Sep 28 16:23:48 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:49 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666" returned: 0 in 0.477s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:49 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125 Sep 28 16:23:49 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:49 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e" returned: 0 in 0.307s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.696s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-816330980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c389c6-a6fc-48c7-aa20-137cfe62df9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fadbdc23b6db486595fdfad601f85d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:48Z,use_quota=True,user_id='ef890231fcff4e7ea3802d7c723888fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Creating volume 25c389c6-a6fc-48c7-aa20-137cfe62df9d {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:23:49 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-25c389c6-a6fc-48c7-aa20-137cfe62df9d 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6c8d7a-c159-40a3-9d22-262698cb4115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:49 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-25c389c6-a6fc-48c7-aa20-137cfe62df9d 1073741824 Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a7feb1-70eb-4c93-8340-d68cb6e367ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:49 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:49 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Volume volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e (3d1997ca-673f-4b3c-9219-72b2a5b2cd7e): created successfully Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a7feb1-70eb-4c93-8340-d68cb6e367ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Flow 'volume_create_manager' (37a0038d-f012-4a9c-8cb0-681b5e89a7f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-fe5ee66f-441c-4e7f-8bea-13b684af5e9b tempest-ProjectMemberTests-462857659 None] Created volume successfully. Sep 28 16:23:49 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125" returned: 0 in 0.380s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:49 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125 Sep 28 16:23:49 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:49 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-25c389c6-a6fc-48c7-aa20-137cfe62df9d 1073741824" returned: 0 in 0.506s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-25c389c6-a6fc-48c7-aa20-137cfe62df9d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:49 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-25c389c6-a6fc-48c7-aa20-137cfe62df9d Sep 28 16:23:49 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:49 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666.7945f17a-ecdb-4c47-b7d6-913c23e96125" returned: 0 in 0.312s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-7945f17a-ecdb-4c47-b7d6-913c23e96125" released by "_delete_snapshot" :: held 1.833s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-b05bbf30-7eae-4041-93cb-5e44911a0666" released by "delete_snapshot" :: held 1.863s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] Created reservations ['b045952c-d4f9-4fdf-8a1a-dc6b3c62f151', 'ffef060d-e66d-4281-94b2-9ce2fce35471', '7d0f28f4-47ae-4e28-9bff-5d96f2521b2b', '38b75ea5-d802-48ab-b245-232664714e96'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] Delete snapshot completed successfully. Sep 28 16:23:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f2aca52c-3aae-4f78-9f7d-0e62cab97479 tempest-ProjectReaderTests-895699407 None] Lock "cinder-7945f17a-ecdb-4c47-b7d6-913c23e96125-delete_snapshot" released by "delete_snapshot" :: held 2.074s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:50 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-25c389c6-a6fc-48c7-aa20-137cfe62df9d" returned: 0 in 0.344s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8d5ed6-4748-44ee-bc47-ff08ffbf5b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25c389c6-a6fc-48c7-aa20-137cfe62df9d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afaed5c8-4267-4372-9dd6-db55b3f4fb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:50 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Volume volume-25c389c6-a6fc-48c7-aa20-137cfe62df9d (25c389c6-a6fc-48c7-aa20-137cfe62df9d): created successfully Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afaed5c8-4267-4372-9dd6-db55b3f4fb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Flow 'volume_create_manager' (342e5e66-8c4e-41a7-9330-0d0dda39634d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:50 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-fd754700-b769-4831-a2b1-8fa000133c9c tempest-ProjectReaderTests-1510768602 None] Created volume successfully. Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-b05bbf30-7eae-4041-93cb-5e44911a0666-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] Lock "cinder-b05bbf30-7eae-4041-93cb-5e44911a0666-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-quobyte-b05bbf30-7eae-4041-93cb-5e44911a0666" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-b05bbf30-7eae-4041-93cb-5e44911a0666" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f13d92f-1785-4e9e-9e7e-43f594abcb3b]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e2feb186-c99b-41d7-9349-c16cdcfcdf46 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e2feb186-c99b-41d7-9349-c16cdcfcdf46 tempest-ProjectMemberTests-462857659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e2feb186-c99b-41d7-9349-c16cdcfcdf46 tempest-ProjectMemberTests-462857659 None] Creating offline snapshot 2f52e4d5-80ff-4852-ba9e-31ac790c6340 of volume 3d1997ca-673f-4b3c-9219-72b2a5b2cd7e {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14954e7-f9bb-42c6-95a5-2cb2b0ecc210]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e2feb186-c99b-41d7-9349-c16cdcfcdf46 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:50 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666 Sep 28 16:23:50 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:50 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e Sep 28 16:23:50 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:50 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666" returned: 0 in 0.469s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:50 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666 Sep 28 16:23:50 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:50 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e2feb186-c99b-41d7-9349-c16cdcfcdf46 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e" returned: 0 in 0.446s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e2feb186-c99b-41d7-9349-c16cdcfcdf46 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:50 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340 1G Sep 28 16:23:50 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:51 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-b05bbf30-7eae-4041-93cb-5e44911a0666" returned: 0 in 0.304s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-b05bbf30-7eae-4041-93cb-5e44911a0666" released by "delete_volume" :: held 0.884s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] Created reservations ['b8ce1dd8-a066-45f3-ab94-844da2e00e9f', '9d83e6c7-3366-4cbb-90e9-13ec39a23d6f', '86837ab8-8819-43a3-baef-1b23f62ca574', '5efdeb63-78f0-4064-9526-0d0272cb2da9'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] Acquiring lock "cinder-25c389c6-a6fc-48c7-aa20-137cfe62df9d-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:51 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:51 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] Lock "cinder-25c389c6-a6fc-48c7-aa20-137cfe62df9d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] Acquiring lock "cinder-quobyte-25c389c6-a6fc-48c7-aa20-137cfe62df9d" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:51 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e2feb186-c99b-41d7-9349-c16cdcfcdf46 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340 1G" returned: 0 in 0.666s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e2feb186-c99b-41d7-9349-c16cdcfcdf46 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] Lock "cinder-quobyte-25c389c6-a6fc-48c7-aa20-137cfe62df9d" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:51 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340 Sep 28 16:23:51 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa5cc72-0af3-41aa-a0d4-244903fac017]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-25c389c6-a6fc-48c7-aa20-137cfe62df9d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:51 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-25c389c6-a6fc-48c7-aa20-137cfe62df9d Sep 28 16:23:51 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:51 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.362s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:51 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] Deleted volume successfully. Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e16be57a-42ea-47b1-aa68-106ca8fa1e9c tempest-ProjectReaderTests-895699407 None] Lock "cinder-b05bbf30-7eae-4041-93cb-5e44911a0666-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:51 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e2feb186-c99b-41d7-9349-c16cdcfcdf46 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340" returned: 0 in 0.412s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:51 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-e2feb186-c99b-41d7-9349-c16cdcfcdf46 tempest-ProjectMemberTests-462857659 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340 is being set with open permissions: ugo+rw Sep 28 16:23:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e2feb186-c99b-41d7-9349-c16cdcfcdf46 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:51 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340 Sep 28 16:23:51 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Flow 'volume_create_manager' (270e846a-3fb7-4bef-a775-c0673cb01c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cf7918-5f0f-4afe-9415-15b008f9e14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:52 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cf7918-5f0f-4afe-9415-15b008f9e14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1631613484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ae7215c3f8d4903b7d7902e311345cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:52Z,use_quota=True,user_id='397c066939cd4186859cbc90175a4a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4ebd38-4c88-4096-bb93-4b27d25ed879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4ebd38-4c88-4096-bb93-4b27d25ed879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37446102-f0d0-46a0-be43-37a3d644f73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37446102-f0d0-46a0-be43-37a3d644f73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335', 'volume_name': 'volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb1b992-1941-48e9-afaa-92b392759ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb1b992-1941-48e9-afaa-92b392759ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfba738b-709a-4780-8bdc-2c0afae19a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:52 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Volume c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335', 'volume_size': 1} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-25c389c6-a6fc-48c7-aa20-137cfe62df9d" returned: 0 in 0.554s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-25c389c6-a6fc-48c7-aa20-137cfe62df9d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:52 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-25c389c6-a6fc-48c7-aa20-137cfe62df9d Sep 28 16:23:52 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:52 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e2feb186-c99b-41d7-9349-c16cdcfcdf46 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340" returned: 0 in 0.275s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e2feb186-c99b-41d7-9349-c16cdcfcdf46 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:52 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.info Sep 28 16:23:52 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:52 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-25c389c6-a6fc-48c7-aa20-137cfe62df9d" returned: 0 in 0.295s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] Lock "cinder-quobyte-25c389c6-a6fc-48c7-aa20-137cfe62df9d" released by "delete_volume" :: held 0.921s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:52 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e2feb186-c99b-41d7-9349-c16cdcfcdf46 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.info" returned: 0 in 0.294s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:52 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-e2feb186-c99b-41d7-9349-c16cdcfcdf46 tempest-ProjectMemberTests-462857659 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.info is being set with open permissions: ugo+rw Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e2feb186-c99b-41d7-9349-c16cdcfcdf46 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] Created reservations ['a64d8492-6e4c-4659-8662-11137ed84af5', '10f2ec4c-85c2-4b20-9860-e5a949439b6a', '6d0291fb-3ec1-425f-ac64-0a87e84d9f09', 'f6d3013e-5bfa-45db-8423-9b7667d69689'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:52 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.info Sep 28 16:23:52 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:52 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:52 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:52 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e2feb186-c99b-41d7-9349-c16cdcfcdf46 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.info" returned: 0 in 0.305s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e2feb186-c99b-41d7-9349-c16cdcfcdf46 tempest-ProjectMemberTests-462857659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1631613484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ae7215c3f8d4903b7d7902e311345cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:52Z,use_quota=True,user_id='397c066939cd4186859cbc90175a4a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Creating volume c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:23:52 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:52 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 1073741824 Sep 28 16:23:52 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:52 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e2feb186-c99b-41d7-9349-c16cdcfcdf46 tempest-ProjectMemberTests-462857659 None] Create snapshot completed successfully Sep 28 16:23:52 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.326s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:52 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:52 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] Deleted volume successfully. Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e5858495-e329-45ab-9011-e8eae26c5443 tempest-ProjectReaderTests-1510768602 None] Lock "cinder-25c389c6-a6fc-48c7-aa20-137cfe62df9d-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:53 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 1073741824" returned: 0 in 0.558s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:53 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 Sep 28 16:23:53 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-2f52e4d5-80ff-4852-ba9e-31ac790c6340-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] Lock "cinder-2f52e4d5-80ff-4852-ba9e-31ac790c6340-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-2f52e4d5-80ff-4852-ba9e-31ac790c6340" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-2f52e4d5-80ff-4852-ba9e-31ac790c6340" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] Deleting offline snapshot 2f52e4d5-80ff-4852-ba9e-31ac790c6340 of volume 3d1997ca-673f-4b3c-9219-72b2a5b2cd7e {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] snapshot_file for this snap is: volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[034538be-ba6e-45a3-b26c-92b9e4360ab2]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:53 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335" returned: 0 in 0.282s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfba738b-709a-4780-8bdc-2c0afae19a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:53 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340 Sep 28 16:23:53 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff702fff-6f48-47e3-9a4e-732c5df2633f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:53 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Volume volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 (c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335): created successfully Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff702fff-6f48-47e3-9a4e-732c5df2633f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Flow 'volume_create_manager' (270e846a-3fb7-4bef-a775-c0673cb01c62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:53 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-fcedecf4-05ff-4117-86f4-896f11d0b478 tempest-ProjectReaderTests-895699407 None] Created volume successfully. Sep 28 16:23:54 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340" returned: 0 in 0.446s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbf7dff-ad58-48fa-aa96-ddd2988ab5d0]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:23:54 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Flow 'volume_create_manager' (f48dccce-30fd-4420-8237-964d1bd02af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:54 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0462862-0693-4b0a-9ef2-2a9800d3d945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0462862-0693-4b0a-9ef2-2a9800d3d945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1438799295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1da7e9d-03dc-45b6-969c-8bb1ab61a405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fadbdc23b6db486595fdfad601f85d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:54Z,use_quota=True,user_id='ef890231fcff4e7ea3802d7c723888fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8534c029-9c1b-4e8d-9db5-d600fa76ff96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8534c029-9c1b-4e8d-9db5-d600fa76ff96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843ba15c-d6b9-4f76-9803-e5d899d67b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843ba15c-d6b9-4f76-9803-e5d899d67b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1da7e9d-03dc-45b6-969c-8bb1ab61a405', 'volume_name': 'volume-c1da7e9d-03dc-45b6-969c-8bb1ab61a405', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb865eb-6c95-4a5e-aaf4-08619b790085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb865eb-6c95-4a5e-aaf4-08619b790085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6003928-568c-4e17-8ca8-5f63e3c62e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:54 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Volume c1da7e9d-03dc-45b6-969c-8bb1ab61a405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1da7e9d-03dc-45b6-969c-8bb1ab61a405', 'volume_size': 1} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1438799295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1da7e9d-03dc-45b6-969c-8bb1ab61a405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fadbdc23b6db486595fdfad601f85d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:54Z,use_quota=True,user_id='ef890231fcff4e7ea3802d7c723888fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Creating volume c1da7e9d-03dc-45b6-969c-8bb1ab61a405 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:23:54 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c1da7e9d-03dc-45b6-969c-8bb1ab61a405 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:54 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c1da7e9d-03dc-45b6-969c-8bb1ab61a405 1073741824 Sep 28 16:23:54 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-969858bb-6239-471d-8547-83329be888a4 tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:54 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e" returned: 0 in 0.478s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:54 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340 Sep 28 16:23:54 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:54 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c1da7e9d-03dc-45b6-969c-8bb1ab61a405 1073741824" returned: 0 in 0.639s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c1da7e9d-03dc-45b6-969c-8bb1ab61a405 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:55 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c1da7e9d-03dc-45b6-969c-8bb1ab61a405 Sep 28 16:23:55 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:55 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340" returned: 0 in 0.531s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:55 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340 Sep 28 16:23:55 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:55 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c1da7e9d-03dc-45b6-969c-8bb1ab61a405" returned: 0 in 0.343s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-969858bb-6239-471d-8547-83329be888a4 tempest-ProjectReaderTests-895699407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.994s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6003928-568c-4e17-8ca8-5f63e3c62e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1da7e9d-03dc-45b6-969c-8bb1ab61a405', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:55 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad61dd28-c367-4373-b6b7-edd2ee1995f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e.2f52e4d5-80ff-4852-ba9e-31ac790c6340" returned: 0 in 0.317s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-969858bb-6239-471d-8547-83329be888a4 tempest-ProjectReaderTests-895699407 None] Creating offline snapshot dc3fbd72-8f73-4870-bdf2-e33b542dae00 of volume c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a316b6-511c-447f-b904-b343ca1a6897]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-969858bb-6239-471d-8547-83329be888a4 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:55 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Volume volume-c1da7e9d-03dc-45b6-969c-8bb1ab61a405 (c1da7e9d-03dc-45b6-969c-8bb1ab61a405): created successfully Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad61dd28-c367-4373-b6b7-edd2ee1995f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Flow 'volume_create_manager' (f48dccce-30fd-4420-8237-964d1bd02af3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-2f52e4d5-80ff-4852-ba9e-31ac790c6340" released by "_delete_snapshot" :: held 1.953s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e" released by "delete_snapshot" :: held 1.981s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:55 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ab370548-d8ca-48cd-96c2-bcad0b9e2326 tempest-ProjectReaderTests-1510768602 None] Created volume successfully. Sep 28 16:23:55 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 Sep 28 16:23:55 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] Created reservations ['7500fafd-73a4-43c5-a5fb-6f28eab6a4ce', '4a531e8f-d59f-4770-b21c-11865681c738', 'f86b81e4-01fd-44b7-b950-96fbc156bd46', '0a25e0bb-d8f1-418e-91ea-d9c244011a05'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:55 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] Delete snapshot completed successfully. Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4df840c0-a950-4ee2-974c-6bcd0205deee tempest-ProjectMemberTests-462857659 None] Lock "cinder-2f52e4d5-80ff-4852-ba9e-31ac790c6340-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:55 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-969858bb-6239-471d-8547-83329be888a4 tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335" returned: 0 in 0.515s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-969858bb-6239-471d-8547-83329be888a4 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:56 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00 1G Sep 28 16:23:56 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] Acquiring lock "cinder-c1da7e9d-03dc-45b6-969c-8bb1ab61a405-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] Lock "cinder-c1da7e9d-03dc-45b6-969c-8bb1ab61a405-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] Acquiring lock "cinder-quobyte-c1da7e9d-03dc-45b6-969c-8bb1ab61a405" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] Lock "cinder-quobyte-c1da7e9d-03dc-45b6-969c-8bb1ab61a405" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:56 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-969858bb-6239-471d-8547-83329be888a4 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00 1G" returned: 0 in 0.613s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-969858bb-6239-471d-8547-83329be888a4 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:56 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3fb563-a9d9-4f19-aba4-86d13eb5572d]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c1da7e9d-03dc-45b6-969c-8bb1ab61a405 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:56 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00 Sep 28 16:23:56 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:56 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c1da7e9d-03dc-45b6-969c-8bb1ab61a405 Sep 28 16:23:56 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] Lock "cinder-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e" acquired by "delete_volume" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02f9ff3-5e85-4ad1-8ac6-21ea51b5bfbe]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:57 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-969858bb-6239-471d-8547-83329be888a4 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00" returned: 0 in 0.488s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:57 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-969858bb-6239-471d-8547-83329be888a4 tempest-ProjectReaderTests-895699407 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00 is being set with open permissions: ugo+rw Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-969858bb-6239-471d-8547-83329be888a4 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:57 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00 Sep 28 16:23:57 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:57 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c1da7e9d-03dc-45b6-969c-8bb1ab61a405" returned: 0 in 0.547s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c1da7e9d-03dc-45b6-969c-8bb1ab61a405 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:57 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e Sep 28 16:23:57 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:57 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c1da7e9d-03dc-45b6-969c-8bb1ab61a405 Sep 28 16:23:57 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:57 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-969858bb-6239-471d-8547-83329be888a4 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00" returned: 0 in 0.282s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-969858bb-6239-471d-8547-83329be888a4 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:57 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.info Sep 28 16:23:57 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:57 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c1da7e9d-03dc-45b6-969c-8bb1ab61a405" returned: 0 in 0.297s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] Lock "cinder-quobyte-c1da7e9d-03dc-45b6-969c-8bb1ab61a405" released by "delete_volume" :: held 0.910s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:57 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e" returned: 0 in 0.455s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:57 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e Sep 28 16:23:57 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] Created reservations ['0f507506-dc9a-42b9-8f2a-e82e4d16d9a7', '27b97171-da37-4ea6-b581-3c855e059b61', 'b5a93451-f6b9-4881-b7b5-edb10eda0887', 'f655df79-712d-44c3-a200-b6fa9b7c56c5'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:57 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-969858bb-6239-471d-8547-83329be888a4 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.info" returned: 0 in 0.307s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:57 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-969858bb-6239-471d-8547-83329be888a4 tempest-ProjectReaderTests-895699407 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.info is being set with open permissions: ugo+rw Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-969858bb-6239-471d-8547-83329be888a4 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:57 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:57 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:57 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.info Sep 28 16:23:57 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:57 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e" returned: 0 in 0.318s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e" released by "delete_volume" :: held 0.862s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] Created reservations ['bdb8606f-2d29-4e90-b97e-1a71bc896add', 'bfec62c9-638e-417a-a26d-44e0f28fb476', '78f0550b-1e72-48ee-ab3b-626e43be3ff8', '3c565a50-afb9-4061-8d87-e7827d9c11f5'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:57 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-969858bb-6239-471d-8547-83329be888a4 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.info" returned: 0 in 0.277s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:57 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-969858bb-6239-471d-8547-83329be888a4 tempest-ProjectReaderTests-895699407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.623s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.322s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] Deleted volume successfully. Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-969858bb-6239-471d-8547-83329be888a4 tempest-ProjectReaderTests-895699407 None] Create snapshot completed successfully Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5d3bdaff-dd6e-4920-b6b0-89a1c4a98d9b tempest-ProjectReaderTests-1510768602 None] Lock "cinder-c1da7e9d-03dc-45b6-969c-8bb1ab61a405-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:58 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:23:58 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:58 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.289s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] Deleted volume successfully. Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dbdbad2c-58bc-4ae8-8101-fbe4c92816b4 tempest-ProjectMemberTests-462857659 None] Lock "cinder-3d1997ca-673f-4b3c-9219-72b2a5b2cd7e-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Flow 'volume_create_manager' (98f15a92-5d56-4adc-bd5c-95be7dc76d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34064fcb-c64d-43f8-b7e7-80d4625b593a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-dc3fbd72-8f73-4870-bdf2-e33b542dae00-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34064fcb-c64d-43f8-b7e7-80d4625b593a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1345102122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e04544-93e6-40d3-955a-8b1515f5e178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7450133953dc42bc96e4113d16a5eb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:59Z,use_quota=True,user_id='ffc597531cc541ce8ddc9f6ac2ca8be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a936fda7-778f-42b1-90ee-bb7ae0b2c36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a936fda7-778f-42b1-90ee-bb7ae0b2c36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3578c2-0da0-418a-83fa-6a3a071a5bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3578c2-0da0-418a-83fa-6a3a071a5bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4e04544-93e6-40d3-955a-8b1515f5e178', 'volume_name': 'volume-e4e04544-93e6-40d3-955a-8b1515f5e178', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ba0b3e-e3d0-4962-a04b-41616f092e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ba0b3e-e3d0-4962-a04b-41616f092e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546db891-df1a-46e1-a9cd-4eedaf52d7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:58 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Volume e4e04544-93e6-40d3-955a-8b1515f5e178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4e04544-93e6-40d3-955a-8b1515f5e178', 'volume_size': 1} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1345102122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e04544-93e6-40d3-955a-8b1515f5e178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7450133953dc42bc96e4113d16a5eb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:59Z,use_quota=True,user_id='ffc597531cc541ce8ddc9f6ac2ca8be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Creating volume e4e04544-93e6-40d3-955a-8b1515f5e178 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:23:58 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:58 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178 1073741824 Sep 28 16:23:58 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] Lock "cinder-dc3fbd72-8f73-4870-bdf2-e33b542dae00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.119s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-quobyte-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-quobyte-dc3fbd72-8f73-4870-bdf2-e33b542dae00" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-dc3fbd72-8f73-4870-bdf2-e33b542dae00" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] Deleting offline snapshot dc3fbd72-8f73-4870-bdf2-e33b542dae00 of volume c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] snapshot_file for this snap is: volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa25652-90ff-4973-a08a-868cd61b4562]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:58 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00 Sep 28 16:23:58 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:59 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178 1073741824" returned: 0 in 0.578s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:59 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00" returned: 0 in 0.486s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ecf660-6785-4b12-b257-f0def2a7ec1c]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:59 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178 Sep 28 16:23:59 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Flow 'volume_create_manager' (badf0440-a2d6-4c0d-bcf4-5aeee683784e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2852eca8-5159-4b78-9356-54701e46edd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2852eca8-5159-4b78-9356-54701e46edd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1053780706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f935f3d-3c83-4b45-a52d-1557fbb512d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fadbdc23b6db486595fdfad601f85d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:59Z,use_quota=True,user_id='ef890231fcff4e7ea3802d7c723888fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5d92aa-ab8d-443f-a95e-649c143ce80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5d92aa-ab8d-443f-a95e-649c143ce80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ec89db-ed01-45c8-bd2e-57d108ca6196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ec89db-ed01-45c8-bd2e-57d108ca6196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f935f3d-3c83-4b45-a52d-1557fbb512d4', 'volume_name': 'volume-7f935f3d-3c83-4b45-a52d-1557fbb512d4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9683c2f3-0f91-4ba3-9b45-3578381ae1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9683c2f3-0f91-4ba3-9b45-3578381ae1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e41d99-184b-4b0b-8b30-9e58a59bb446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:59 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 Sep 28 16:23:59 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Volume 7f935f3d-3c83-4b45-a52d-1557fbb512d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f935f3d-3c83-4b45-a52d-1557fbb512d4', 'volume_size': 1} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:59 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:59 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178" returned: 0 in 0.273s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.129s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1053780706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f935f3d-3c83-4b45-a52d-1557fbb512d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fadbdc23b6db486595fdfad601f85d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:59Z,use_quota=True,user_id='ef890231fcff4e7ea3802d7c723888fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Creating volume 7f935f3d-3c83-4b45-a52d-1557fbb512d4 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:23:59 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f935f3d-3c83-4b45-a52d-1557fbb512d4 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:59 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f935f3d-3c83-4b45-a52d-1557fbb512d4 1073741824 Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546db891-df1a-46e1-a9cd-4eedaf52d7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4e04544-93e6-40d3-955a-8b1515f5e178', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:59 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb39a073-e715-486e-85ec-cc792553f3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:59 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Volume volume-e4e04544-93e6-40d3-955a-8b1515f5e178 (e4e04544-93e6-40d3-955a-8b1515f5e178): created successfully Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb39a073-e715-486e-85ec-cc792553f3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Flow 'volume_create_manager' (98f15a92-5d56-4adc-bd5c-95be7dc76d7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:59 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-da3ca461-0201-4fda-9365-be55e7caae2d tempest-ProjectMemberTests-462857659 None] Created volume successfully. Sep 28 16:23:59 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335" returned: 0 in 0.491s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:59 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00 Sep 28 16:23:59 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:00 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:00 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00" returned: 0 in 0.394s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f935f3d-3c83-4b45-a52d-1557fbb512d4 1073741824" returned: 0 in 0.616s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:00 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00 Sep 28 16:24:00 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f935f3d-3c83-4b45-a52d-1557fbb512d4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:00 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f935f3d-3c83-4b45-a52d-1557fbb512d4 Sep 28 16:24:00 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:00 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335.dc3fbd72-8f73-4870-bdf2-e33b542dae00" returned: 0 in 0.291s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:00 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f935f3d-3c83-4b45-a52d-1557fbb512d4" returned: 0 in 0.269s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-dc3fbd72-8f73-4870-bdf2-e33b542dae00" released by "_delete_snapshot" :: held 1.811s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335" released by "delete_snapshot" :: held 1.847s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e41d99-184b-4b0b-8b30-9e58a59bb446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f935f3d-3c83-4b45-a52d-1557fbb512d4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8233e49-fa9a-4f46-832c-fb18454d821d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:00 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Volume volume-7f935f3d-3c83-4b45-a52d-1557fbb512d4 (7f935f3d-3c83-4b45-a52d-1557fbb512d4): created successfully Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8233e49-fa9a-4f46-832c-fb18454d821d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Flow 'volume_create_manager' (badf0440-a2d6-4c0d-bcf4-5aeee683784e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ce6cfd85-b55a-48ec-9934-d404c71de265 tempest-ProjectReaderTests-1510768602 None] Created volume successfully. Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] Created reservations ['b997d318-d3d5-4fb0-9384-fb7f9de711d2', '729d08f6-9d37-4a68-aaf4-4c717c416a12', 'b649f167-d0b7-4e57-ace1-a60b012caf03', '58073b91-7d73-43f0-9ee5-fed2d53c4407'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] Delete snapshot completed successfully. Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6b3c0870-c0d2-42d5-bc9e-6c0d9d721720 tempest-ProjectReaderTests-895699407 None] Lock "cinder-dc3fbd72-8f73-4870-bdf2-e33b542dae00-delete_snapshot" released by "delete_snapshot" :: held 2.067s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d639b488-2c83-4c7a-99bd-def0a683e2f2 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d639b488-2c83-4c7a-99bd-def0a683e2f2 tempest-ProjectMemberTests-462857659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d639b488-2c83-4c7a-99bd-def0a683e2f2 tempest-ProjectMemberTests-462857659 None] Creating offline snapshot 44a1ef2f-1b01-4a0a-9764-50fe40a625aa of volume e4e04544-93e6-40d3-955a-8b1515f5e178 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3898b4f6-91a7-4db7-905c-ed7b592dfcce]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d639b488-2c83-4c7a-99bd-def0a683e2f2 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:01 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178 Sep 28 16:24:01 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:01 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d639b488-2c83-4c7a-99bd-def0a683e2f2 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178" returned: 0 in 0.390s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d639b488-2c83-4c7a-99bd-def0a683e2f2 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:01 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa 1G Sep 28 16:24:01 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] Acquiring lock "cinder-7f935f3d-3c83-4b45-a52d-1557fbb512d4-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] Lock "cinder-7f935f3d-3c83-4b45-a52d-1557fbb512d4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] Acquiring lock "cinder-quobyte-7f935f3d-3c83-4b45-a52d-1557fbb512d4" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] Lock "cinder-quobyte-7f935f3d-3c83-4b45-a52d-1557fbb512d4" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:01 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fb65a6-714b-4ad3-9e4f-397a3ecb47c8]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f935f3d-3c83-4b45-a52d-1557fbb512d4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:01 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f935f3d-3c83-4b45-a52d-1557fbb512d4 Sep 28 16:24:01 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:01 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d639b488-2c83-4c7a-99bd-def0a683e2f2 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa 1G" returned: 0 in 0.491s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d639b488-2c83-4c7a-99bd-def0a683e2f2 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4e04544-93e6-40d3-955a-8b1515f5e178 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:01 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4e04544-93e6-40d3-955a-8b1515f5e178 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa Sep 28 16:24:01 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] Lock "cinder-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] Acquiring lock "cinder-quobyte-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335" acquired by "delete_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a7c6af-8925-4c60-a306-fe10d5185123]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:02 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f935f3d-3c83-4b45-a52d-1557fbb512d4" returned: 0 in 0.512s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f935f3d-3c83-4b45-a52d-1557fbb512d4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:02 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f935f3d-3c83-4b45-a52d-1557fbb512d4 Sep 28 16:24:02 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:02 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d639b488-2c83-4c7a-99bd-def0a683e2f2 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4e04544-93e6-40d3-955a-8b1515f5e178 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa" returned: 0 in 0.338s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:02 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-d639b488-2c83-4c7a-99bd-def0a683e2f2 tempest-ProjectMemberTests-462857659 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa is being set with open permissions: ugo+rw Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d639b488-2c83-4c7a-99bd-def0a683e2f2 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:02 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa Sep 28 16:24:02 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:02 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 Sep 28 16:24:02 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:02 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7f935f3d-3c83-4b45-a52d-1557fbb512d4" returned: 0 in 0.296s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] Lock "cinder-quobyte-7f935f3d-3c83-4b45-a52d-1557fbb512d4" released by "delete_volume" :: held 0.859s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:02 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d639b488-2c83-4c7a-99bd-def0a683e2f2 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa" returned: 0 in 0.272s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d639b488-2c83-4c7a-99bd-def0a683e2f2 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:02 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:02 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.info Sep 28 16:24:02 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335" returned: 0 in 0.442s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:02 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335 Sep 28 16:24:02 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] Created reservations ['60222e50-7e0d-4ead-b986-6a174c6fe817', 'b83f64ce-332c-4345-8d3e-4fd7c7940140', 'e31a5041-0706-4f11-a8ba-76a5d08557bb', '41ca8f74-51ed-44d8-bf38-2123c3c2f18b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:02 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:24:02 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:02 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d639b488-2c83-4c7a-99bd-def0a683e2f2 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.info" returned: 0 in 0.342s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:02 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-d639b488-2c83-4c7a-99bd-def0a683e2f2 tempest-ProjectMemberTests-462857659 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.info is being set with open permissions: ugo+rw Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d639b488-2c83-4c7a-99bd-def0a683e2f2 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:02 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335" returned: 0 in 0.332s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:02 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.info Sep 28 16:24:02 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] Lock "cinder-quobyte-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335" released by "delete_volume" :: held 0.870s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:02 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] Created reservations ['423cb5e3-34b1-499f-9312-9177d6d57706', '399f2c41-e3d7-49b4-8888-8f1055788c9e', '0b8f3f54-6284-4c94-8ea6-a9969e239f37', '678ffdbf-70e0-454c-beb0-42d014856dcd'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:02 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.349s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:03 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:24:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] Deleted volume successfully. Sep 28 16:24:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a768239d-197a-4a9a-ade1-385543c645cb tempest-ProjectReaderTests-1510768602 None] Lock "cinder-7f935f3d-3c83-4b45-a52d-1557fbb512d4-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:03 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:24:03 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:03 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d639b488-2c83-4c7a-99bd-def0a683e2f2 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.info" returned: 0 in 0.326s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d639b488-2c83-4c7a-99bd-def0a683e2f2 tempest-ProjectMemberTests-462857659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.267s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d639b488-2c83-4c7a-99bd-def0a683e2f2 tempest-ProjectMemberTests-462857659 None] Create snapshot completed successfully Sep 28 16:24:03 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.303s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:03 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:24:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] Deleted volume successfully. Sep 28 16:24:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a9809375-b0bc-4051-8587-72ca689b4baf tempest-ProjectReaderTests-895699407 None] Lock "cinder-c59b0902-8d0b-4b3b-b0b8-4bdb81fc7335-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-44a1ef2f-1b01-4a0a-9764-50fe40a625aa-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] Lock "cinder-44a1ef2f-1b01-4a0a-9764-50fe40a625aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-e4e04544-93e6-40d3-955a-8b1515f5e178" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-e4e04544-93e6-40d3-955a-8b1515f5e178" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-44a1ef2f-1b01-4a0a-9764-50fe40a625aa" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-44a1ef2f-1b01-4a0a-9764-50fe40a625aa" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] Deleting offline snapshot 44a1ef2f-1b01-4a0a-9764-50fe40a625aa of volume e4e04544-93e6-40d3-955a-8b1515f5e178 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:24:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] snapshot_file for this snap is: volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:24:04 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfb7c67-d525-4a77-b172-fa742413e258]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:04 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa Sep 28 16:24:04 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:04 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa" returned: 0 in 0.527s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4e04544-93e6-40d3-955a-8b1515f5e178(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:24:04 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[323e37cb-a390-4747-a9ca-c0c1de6bf805]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:05 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178 Sep 28 16:24:05 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:05 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178" returned: 0 in 0.519s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:05 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa Sep 28 16:24:05 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:05 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa" returned: 0 in 0.453s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:05 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa Sep 28 16:24:05 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:06 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178.44a1ef2f-1b01-4a0a-9764-50fe40a625aa" returned: 0 in 0.289s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-44a1ef2f-1b01-4a0a-9764-50fe40a625aa" released by "_delete_snapshot" :: held 1.944s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-e4e04544-93e6-40d3-955a-8b1515f5e178" released by "delete_snapshot" :: held 1.991s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:06 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] Created reservations ['a35468b2-c2ea-49ac-9a21-afe435e00e93', '43e2529e-625e-4313-b4c6-72d2f0c39397', '73739df5-e76a-47cb-bfa1-97f56c7d19e0', '0385e0b9-52cf-4e5d-8970-f389df5c6e68'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:06 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] Delete snapshot completed successfully. Sep 28 16:24:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b04bea39-34a5-493f-b1fc-191e51e71d5b tempest-ProjectMemberTests-462857659 None] Lock "cinder-44a1ef2f-1b01-4a0a-9764-50fe40a625aa-delete_snapshot" released by "delete_snapshot" :: held 2.185s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-e4e04544-93e6-40d3-955a-8b1515f5e178-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] Lock "cinder-e4e04544-93e6-40d3-955a-8b1515f5e178-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-e4e04544-93e6-40d3-955a-8b1515f5e178" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-e4e04544-93e6-40d3-955a-8b1515f5e178" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:07 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd04c9e6-1758-483e-9d19-769da1780eeb]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:07 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178 Sep 28 16:24:07 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:07 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178" returned: 0 in 0.430s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:07 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178 Sep 28 16:24:07 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Flow 'volume_create_manager' (dd9813fa-f409-4d5c-a047-2a8417e5cc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa28560f-a4cb-4224-8660-c3fe78c200c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa28560f-a4cb-4224-8660-c3fe78c200c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1817319690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7b281be86b4c37be3e148d918cfa13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:08Z,use_quota=True,user_id='6c02f57be024426ab9e75a6791aade1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909f19e1-5fdb-4bcd-b8f3-9e66b89b60f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909f19e1-5fdb-4bcd-b8f3-9e66b89b60f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c60ea60-36ed-4e8b-b71e-842c0799664c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c60ea60-36ed-4e8b-b71e-842c0799664c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd', 'volume_name': 'volume-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409f1e8d-7b99-4f86-bf69-ea54c525de78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:08 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409f1e8d-7b99-4f86-bf69-ea54c525de78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ceea83-aab8-4c87-a915-85d5fd04663c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:08 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Volume 585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd', 'volume_size': 1} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1817319690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7b281be86b4c37be3e148d918cfa13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:08Z,use_quota=True,user_id='6c02f57be024426ab9e75a6791aade1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Creating volume 585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:24:08 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-e4e04544-93e6-40d3-955a-8b1515f5e178" returned: 0 in 0.306s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:08 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd 1073741824 Sep 28 16:24:08 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-e4e04544-93e6-40d3-955a-8b1515f5e178" released by "delete_volume" :: held 0.811s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] Created reservations ['cb217dc5-071a-4345-980a-aab300b8e6c0', '5d83556c-bd27-4dc9-b1c7-f3d069b16646', 'dae80fcb-6a73-4c42-8384-fee0956c1826', '1fe2e4c4-b195-4146-b605-47d6c114bd67'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:08 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:24:08 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:08 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.298s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:24:08 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] Deleted volume successfully. Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a7f39496-107b-4a43-bcba-220dd20197e5 tempest-ProjectMemberTests-462857659 None] Lock "cinder-e4e04544-93e6-40d3-955a-8b1515f5e178-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:08 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd 1073741824" returned: 0 in 0.537s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:08 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd Sep 28 16:24:08 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:09 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd" returned: 0 in 0.309s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ceea83-aab8-4c87-a915-85d5fd04663c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e923a3a5-9a4e-411d-8e38-24df7fab9567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:09 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Volume volume-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd (585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd): created successfully Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e923a3a5-9a4e-411d-8e38-24df7fab9567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Flow 'volume_create_manager' (dd9813fa-f409-4d5c-a047-2a8417e5cc2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:09 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-33a5bd7b-7d9e-4071-9a8e-58f5a585baed tempest-ProjectReaderTests-1827195879 None] Created volume successfully. Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Flow 'volume_create_manager' (a96209d4-8908-4135-bc43-392766ff7e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c84188-2798-4ac8-9f3e-6f578fd302fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c84188-2798-4ac8-9f3e-6f578fd302fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-157050912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88de2098-55f7-4af8-875d-a82ee6d4acd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7450133953dc42bc96e4113d16a5eb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:09Z,use_quota=True,user_id='ffc597531cc541ce8ddc9f6ac2ca8be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407da8b4-469a-4cbb-9547-408108abb5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407da8b4-469a-4cbb-9547-408108abb5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e8f80e-e720-4b40-b389-7fe000392e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e8f80e-e720-4b40-b389-7fe000392e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88de2098-55f7-4af8-875d-a82ee6d4acd8', 'volume_name': 'volume-88de2098-55f7-4af8-875d-a82ee6d4acd8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1bd3e2d-7652-4e6f-a97c-ee7f91c9e04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1bd3e2d-7652-4e6f-a97c-ee7f91c9e04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4569fcb6-9879-4137-9383-d92ac3e093f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:09 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Volume 88de2098-55f7-4af8-875d-a82ee6d4acd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88de2098-55f7-4af8-875d-a82ee6d4acd8', 'volume_size': 1} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-157050912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88de2098-55f7-4af8-875d-a82ee6d4acd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7450133953dc42bc96e4113d16a5eb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:09Z,use_quota=True,user_id='ffc597531cc541ce8ddc9f6ac2ca8be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Creating volume 88de2098-55f7-4af8-875d-a82ee6d4acd8 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:24:09 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:09 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8 1073741824 Sep 28 16:24:09 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:09 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8 1073741824" returned: 0 in 0.468s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:09 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8 Sep 28 16:24:09 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:10 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8" returned: 0 in 0.276s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:24:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4569fcb6-9879-4137-9383-d92ac3e093f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88de2098-55f7-4af8-875d-a82ee6d4acd8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47880a27-362d-49e2-be8c-ebea2a2fca98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:10 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Volume volume-88de2098-55f7-4af8-875d-a82ee6d4acd8 (88de2098-55f7-4af8-875d-a82ee6d4acd8): created successfully Sep 28 16:24:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47880a27-362d-49e2-be8c-ebea2a2fca98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Flow 'volume_create_manager' (a96209d4-8908-4135-bc43-392766ff7e2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2570c062-48f7-4acc-aead-bdc8eda7a1f6 tempest-ProjectMemberTests-462857659 None] Created volume successfully. Sep 28 16:24:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] Acquiring lock "cinder-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] Lock "cinder-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] Acquiring lock "cinder-quobyte-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] Lock "cinder-quobyte-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd" acquired by "delete_volume" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:10 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d35b954-d65d-450a-828c-85d46ca25607]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:10 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd Sep 28 16:24:10 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:10 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd" returned: 0 in 0.377s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:10 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd Sep 28 16:24:10 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:11 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd" returned: 0 in 0.250s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] Lock "cinder-quobyte-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd" released by "delete_volume" :: held 0.672s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:11 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] Created reservations ['a79d6edc-1d5a-4ae1-aac7-fadb1b32f734', '0d8c60d1-33c9-4959-8f0f-feaf3f9f3a96', 'a568ee09-fd9e-465d-ba91-43c55b64a8d2', '1d520782-b0ab-4466-9500-9f99a5aab3b1'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:11 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:24:11 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-48a319fd-c5a3-42c0-9e59-d239d3dc48e5 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-48a319fd-c5a3-42c0-9e59-d239d3dc48e5 tempest-ProjectMemberTests-462857659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-48a319fd-c5a3-42c0-9e59-d239d3dc48e5 tempest-ProjectMemberTests-462857659 None] Creating offline snapshot f7a27c65-76a1-47cc-805f-02ac3e7ab6bc of volume 88de2098-55f7-4af8-875d-a82ee6d4acd8 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:24:11 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9897e2e4-5387-4066-a261-729f09a7469d]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-48a319fd-c5a3-42c0-9e59-d239d3dc48e5 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:11 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.333s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:11 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:24:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] Deleted volume successfully. Sep 28 16:24:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2d8c3d36-58c4-4015-a87f-6c5e01273536 tempest-ProjectReaderTests-1827195879 None] Lock "cinder-585b27df-7fe2-4c76-bfbb-2a1c9a60e0dd-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:11 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8 Sep 28 16:24:11 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:12 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-48a319fd-c5a3-42c0-9e59-d239d3dc48e5 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8" returned: 0 in 0.486s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-48a319fd-c5a3-42c0-9e59-d239d3dc48e5 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:12 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc 1G Sep 28 16:24:12 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:12 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:24:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Flow 'volume_create_manager' (22645a93-7853-4d37-98e8-266fe810d0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482fe9ee-c0e4-4173-b62f-ae3c40d52714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482fe9ee-c0e4-4173-b62f-ae3c40d52714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259401613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7b281be86b4c37be3e148d918cfa13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:12Z,use_quota=True,user_id='6c02f57be024426ab9e75a6791aade1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a69e66-8dde-4511-abd6-cf1064e8ed88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a69e66-8dde-4511-abd6-cf1064e8ed88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82214db4-ee7f-4610-919a-a1f1dfbd9015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82214db4-ee7f-4610-919a-a1f1dfbd9015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52', 'volume_name': 'volume-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff8e2c7-deeb-471f-8d5a-058bbcfd1586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff8e2c7-deeb-471f-8d5a-058bbcfd1586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77aff095-223e-46b4-8f00-53407038186e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:12 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Volume ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52', 'volume_size': 1} Sep 28 16:24:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:12 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-48a319fd-c5a3-42c0-9e59-d239d3dc48e5 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc 1G" returned: 0 in 0.431s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-48a319fd-c5a3-42c0-9e59-d239d3dc48e5 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88de2098-55f7-4af8-875d-a82ee6d4acd8 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:12 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88de2098-55f7-4af8-875d-a82ee6d4acd8 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc Sep 28 16:24:12 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:12 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-48a319fd-c5a3-42c0-9e59-d239d3dc48e5 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88de2098-55f7-4af8-875d-a82ee6d4acd8 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc" returned: 0 in 0.349s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:12 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-48a319fd-c5a3-42c0-9e59-d239d3dc48e5 tempest-ProjectMemberTests-462857659 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc is being set with open permissions: ugo+rw Sep 28 16:24:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-48a319fd-c5a3-42c0-9e59-d239d3dc48e5 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:12 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc Sep 28 16:24:12 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:13 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-48a319fd-c5a3-42c0-9e59-d239d3dc48e5 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc" returned: 0 in 0.276s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-48a319fd-c5a3-42c0-9e59-d239d3dc48e5 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:13 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.info Sep 28 16:24:13 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:13 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-48a319fd-c5a3-42c0-9e59-d239d3dc48e5 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.info" returned: 0 in 0.258s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:13 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-48a319fd-c5a3-42c0-9e59-d239d3dc48e5 tempest-ProjectMemberTests-462857659 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.info is being set with open permissions: ugo+rw Sep 28 16:24:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-48a319fd-c5a3-42c0-9e59-d239d3dc48e5 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:13 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.info Sep 28 16:24:13 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:13 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-48a319fd-c5a3-42c0-9e59-d239d3dc48e5 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.info" returned: 0 in 0.286s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-48a319fd-c5a3-42c0-9e59-d239d3dc48e5 tempest-ProjectMemberTests-462857659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.197s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.428s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259401613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7b281be86b4c37be3e148d918cfa13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:12Z,use_quota=True,user_id='6c02f57be024426ab9e75a6791aade1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:24:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Creating volume ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:24:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:24:13 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:24:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:13 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52 1073741824 Sep 28 16:24:13 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:13 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-48a319fd-c5a3-42c0-9e59-d239d3dc48e5 tempest-ProjectMemberTests-462857659 None] Create snapshot completed successfully Sep 28 16:24:14 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52 1073741824" returned: 0 in 0.458s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:14 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52 Sep 28 16:24:14 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:14 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52" returned: 0 in 0.280s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:24:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77aff095-223e-46b4-8f00-53407038186e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c0d6dff-ed78-4b8b-b2d3-e2807868d7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:14 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Volume volume-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52 (ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52): created successfully Sep 28 16:24:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c0d6dff-ed78-4b8b-b2d3-e2807868d7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Flow 'volume_create_manager' (22645a93-7853-4d37-98e8-266fe810d0fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:14 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-bfd1ae4c-907a-4e44-8c8f-e01022f9ed63 tempest-ProjectReaderTests-1827195879 None] Created volume successfully. Sep 28 16:24:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-f7a27c65-76a1-47cc-805f-02ac3e7ab6bc-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] Lock "cinder-f7a27c65-76a1-47cc-805f-02ac3e7ab6bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-88de2098-55f7-4af8-875d-a82ee6d4acd8" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-88de2098-55f7-4af8-875d-a82ee6d4acd8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-f7a27c65-76a1-47cc-805f-02ac3e7ab6bc" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-f7a27c65-76a1-47cc-805f-02ac3e7ab6bc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] Deleting offline snapshot f7a27c65-76a1-47cc-805f-02ac3e7ab6bc of volume 88de2098-55f7-4af8-875d-a82ee6d4acd8 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:24:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] snapshot_file for this snap is: volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:24:14 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9fa658-c5d5-41ea-8680-556175dd7ff9]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:14 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc Sep 28 16:24:14 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:15 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc" returned: 0 in 0.394s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88de2098-55f7-4af8-875d-a82ee6d4acd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:24:15 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5aeeafa-94fb-4281-8ab1-c653b41e5675]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] Acquiring lock "cinder-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] Lock "cinder-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:15 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8 Sep 28 16:24:15 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] Acquiring lock "cinder-quobyte-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] Lock "cinder-quobyte-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:15 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4545bbe9-470c-430a-b6b8-fc5b0b176ca9]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:15 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52 Sep 28 16:24:15 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:15 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8" returned: 0 in 0.490s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:15 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc Sep 28 16:24:15 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:15 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52" returned: 0 in 0.482s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:16 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52 Sep 28 16:24:16 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:16 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc" returned: 0 in 0.402s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:16 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc Sep 28 16:24:16 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:16 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52" returned: 0 in 0.304s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] Lock "cinder-quobyte-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52" released by "delete_volume" :: held 0.838s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] Created reservations ['3556b881-dda1-41ad-b093-26f110637425', 'faeba029-59ee-463e-bb75-cf7a7d655855', '60fb168e-1d9c-4829-81c0-ecd71539f420', 'e9ed28d9-091e-4d0d-a578-ea65adb5ed60'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:16 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8.f7a27c65-76a1-47cc-805f-02ac3e7ab6bc" returned: 0 in 0.295s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-f7a27c65-76a1-47cc-805f-02ac3e7ab6bc" released by "_delete_snapshot" :: held 1.707s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-88de2098-55f7-4af8-875d-a82ee6d4acd8" released by "delete_snapshot" :: held 1.742s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:16 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:24:16 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] Created reservations ['6639cab7-32fc-4dad-9133-9aff1888da27', 'da47fe17-a168-4105-994d-a6552fcda648', 'b5f5334f-c13c-4afc-bdab-d72e2eb42bf9', '252eb3da-de24-4cf9-9266-0cc935680fdb'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:16 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] Delete snapshot completed successfully. Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-97329681-29f0-44f5-abf2-cc29a288e7c4 tempest-ProjectMemberTests-462857659 None] Lock "cinder-f7a27c65-76a1-47cc-805f-02ac3e7ab6bc-delete_snapshot" released by "delete_snapshot" :: held 1.961s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:16 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.340s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:24:16 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] Deleted volume successfully. Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d90bb56b-76eb-4731-8ba8-3669475de4e4 tempest-ProjectReaderTests-1827195879 None] Lock "cinder-ef9ba4cc-9b4d-4b61-9ce8-93e03873cf52-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-88de2098-55f7-4af8-875d-a82ee6d4acd8-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] Lock "cinder-88de2098-55f7-4af8-875d-a82ee6d4acd8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-88de2098-55f7-4af8-875d-a82ee6d4acd8" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-88de2098-55f7-4af8-875d-a82ee6d4acd8" acquired by "delete_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:17 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6319e0c4-05b8-4249-a3f5-a8f3363f26fc]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:17 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8 Sep 28 16:24:17 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:17 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8" returned: 0 in 0.522s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:17 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8 Sep 28 16:24:17 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:17 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-88de2098-55f7-4af8-875d-a82ee6d4acd8" returned: 0 in 0.292s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-88de2098-55f7-4af8-875d-a82ee6d4acd8" released by "delete_volume" :: held 0.911s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:17 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=172,cinder:UPDATE=224,cinder:INSERT=70,cinder:DELETE=23 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:24:17 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=187,cinder:INSERT=63,cinder:UPDATE=251,cinder:DELETE=17 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:24:18 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] Created reservations ['867083fe-8b88-4f0d-b472-eb89542eeb2a', 'f78c3867-3ad8-4c11-b2e5-7d8ec4b4edd7', '055d379d-a40f-446a-b78f-ffa2450ed438', '03503d97-7fac-4c60-9a8a-a8d3fd65776c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:18 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:24:18 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:18 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.279s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:18 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:24:18 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] Deleted volume successfully. Sep 28 16:24:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-59ba81d4-6eec-4673-93b0-2f9ae7092858 tempest-ProjectMemberTests-462857659 None] Lock "cinder-88de2098-55f7-4af8-875d-a82ee6d4acd8-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Flow 'volume_create_manager' (904eb636-5e92-4cf0-a0f8-2cf7ebbdd948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f76470bf-7906-4d8c-af3c-e5a1baaf1156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f76470bf-7906-4d8c-af3c-e5a1baaf1156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1924059225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7575076c-db1e-4544-a535-942be06237c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7450133953dc42bc96e4113d16a5eb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:20Z,use_quota=True,user_id='ffc597531cc541ce8ddc9f6ac2ca8be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e473a4d6-c855-442a-86af-eddd3c4c8958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e473a4d6-c855-442a-86af-eddd3c4c8958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a00e341-d222-4b32-a954-f80312e09283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a00e341-d222-4b32-a954-f80312e09283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7575076c-db1e-4544-a535-942be06237c4', 'volume_name': 'volume-7575076c-db1e-4544-a535-942be06237c4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9609b28b-b4c4-460d-9d93-f76f27b68ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9609b28b-b4c4-460d-9d93-f76f27b68ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32da5e3a-2b3d-4642-bab9-b5bd12528c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:19 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Volume 7575076c-db1e-4544-a535-942be06237c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7575076c-db1e-4544-a535-942be06237c4', 'volume_size': 1} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1924059225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7575076c-db1e-4544-a535-942be06237c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7450133953dc42bc96e4113d16a5eb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:20Z,use_quota=True,user_id='ffc597531cc541ce8ddc9f6ac2ca8be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Creating volume 7575076c-db1e-4544-a535-942be06237c4 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:24:19 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:24:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:19 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4 1073741824 Sep 28 16:24:19 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:20 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4 1073741824" returned: 0 in 0.527s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:20 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4 Sep 28 16:24:20 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:20 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4" returned: 0 in 0.296s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:24:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32da5e3a-2b3d-4642-bab9-b5bd12528c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7575076c-db1e-4544-a535-942be06237c4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4373ef-9df4-46c6-a244-08c43410de87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:20 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Volume volume-7575076c-db1e-4544-a535-942be06237c4 (7575076c-db1e-4544-a535-942be06237c4): created successfully Sep 28 16:24:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4373ef-9df4-46c6-a244-08c43410de87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Flow 'volume_create_manager' (904eb636-5e92-4cf0-a0f8-2cf7ebbdd948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:20 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3fc18a65-60a4-44e1-bca0-5350f5064551 tempest-ProjectMemberTests-462857659 None] Created volume successfully. Sep 28 16:24:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-af2a8b26-fd82-448e-8107-de8b380af2ac tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-af2a8b26-fd82-448e-8107-de8b380af2ac tempest-ProjectMemberTests-462857659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-af2a8b26-fd82-448e-8107-de8b380af2ac tempest-ProjectMemberTests-462857659 None] Creating offline snapshot bcced3d6-656b-4119-bcc2-2df9ca01bad2 of volume 7575076c-db1e-4544-a535-942be06237c4 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:24:22 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6044628-cfd0-43ea-9902-de5879d79580]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af2a8b26-fd82-448e-8107-de8b380af2ac tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:22 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4 Sep 28 16:24:22 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:22 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af2a8b26-fd82-448e-8107-de8b380af2ac tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4" returned: 0 in 0.405s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af2a8b26-fd82-448e-8107-de8b380af2ac tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:22 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2 1G Sep 28 16:24:22 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:22 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af2a8b26-fd82-448e-8107-de8b380af2ac tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2 1G" returned: 0 in 0.482s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af2a8b26-fd82-448e-8107-de8b380af2ac tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7575076c-db1e-4544-a535-942be06237c4 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:23 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7575076c-db1e-4544-a535-942be06237c4 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2 Sep 28 16:24:23 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:23 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af2a8b26-fd82-448e-8107-de8b380af2ac tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7575076c-db1e-4544-a535-942be06237c4 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2" returned: 0 in 0.356s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:23 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-af2a8b26-fd82-448e-8107-de8b380af2ac tempest-ProjectMemberTests-462857659 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2 is being set with open permissions: ugo+rw Sep 28 16:24:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af2a8b26-fd82-448e-8107-de8b380af2ac tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:23 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2 Sep 28 16:24:23 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:23 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af2a8b26-fd82-448e-8107-de8b380af2ac tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2" returned: 0 in 0.272s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af2a8b26-fd82-448e-8107-de8b380af2ac tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:23 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.info Sep 28 16:24:23 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:23 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af2a8b26-fd82-448e-8107-de8b380af2ac tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.info" returned: 0 in 0.253s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:23 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-af2a8b26-fd82-448e-8107-de8b380af2ac tempest-ProjectMemberTests-462857659 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.info is being set with open permissions: ugo+rw Sep 28 16:24:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af2a8b26-fd82-448e-8107-de8b380af2ac tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:23 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.info Sep 28 16:24:23 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:24 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af2a8b26-fd82-448e-8107-de8b380af2ac tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.info" returned: 0 in 0.247s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-af2a8b26-fd82-448e-8107-de8b380af2ac tempest-ProjectMemberTests-462857659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-af2a8b26-fd82-448e-8107-de8b380af2ac tempest-ProjectMemberTests-462857659 None] Create snapshot completed successfully Sep 28 16:24:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-bcced3d6-656b-4119-bcc2-2df9ca01bad2-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] Lock "cinder-bcced3d6-656b-4119-bcc2-2df9ca01bad2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-7575076c-db1e-4544-a535-942be06237c4" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-7575076c-db1e-4544-a535-942be06237c4" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-bcced3d6-656b-4119-bcc2-2df9ca01bad2" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-bcced3d6-656b-4119-bcc2-2df9ca01bad2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] Deleting offline snapshot bcced3d6-656b-4119-bcc2-2df9ca01bad2 of volume 7575076c-db1e-4544-a535-942be06237c4 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:24:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] snapshot_file for this snap is: volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:24:25 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[163798e0-7e36-4c9a-996a-cf1d1c1d7bd5]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:25 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2 Sep 28 16:24:25 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:25 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2" returned: 0 in 0.440s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7575076c-db1e-4544-a535-942be06237c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:24:25 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[75253487-857d-46c4-9307-cc9021ebc620]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:26 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4 Sep 28 16:24:26 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:26 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4" returned: 0 in 0.418s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:26 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2 Sep 28 16:24:26 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:26 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2" returned: 0 in 0.417s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:26 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2 Sep 28 16:24:26 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:27 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4.bcced3d6-656b-4119-bcc2-2df9ca01bad2" returned: 0 in 0.287s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-bcced3d6-656b-4119-bcc2-2df9ca01bad2" released by "_delete_snapshot" :: held 1.718s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-7575076c-db1e-4544-a535-942be06237c4" released by "delete_snapshot" :: held 1.750s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:27 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] Created reservations ['d12d735c-0c81-4752-84f3-aa8667787867', 'd46bdd75-2a8c-42fa-8041-517f649c6468', '06273fb8-26ad-47e7-b965-ca51451ccac0', '2ab874a0-e9ef-4cb0-991e-6536dec05c22'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] Delete snapshot completed successfully. Sep 28 16:24:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a370c35d-283d-4c52-8fd1-8b3b29220f5f tempest-ProjectMemberTests-462857659 None] Lock "cinder-bcced3d6-656b-4119-bcc2-2df9ca01bad2-delete_snapshot" released by "delete_snapshot" :: held 1.935s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-7575076c-db1e-4544-a535-942be06237c4-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] Lock "cinder-7575076c-db1e-4544-a535-942be06237c4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-7575076c-db1e-4544-a535-942be06237c4" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-7575076c-db1e-4544-a535-942be06237c4" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:27 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b1d804-c6af-46cd-be86-3ea310c3c132]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:27 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4 Sep 28 16:24:27 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:28 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4" returned: 0 in 0.444s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:28 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4 Sep 28 16:24:28 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:28 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-7575076c-db1e-4544-a535-942be06237c4" returned: 0 in 0.296s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-7575076c-db1e-4544-a535-942be06237c4" released by "delete_volume" :: held 0.814s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:28 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] Created reservations ['006892b6-7137-4335-93f5-b5b7172adf8d', '1a843faf-06f1-4fc5-ae8c-67300760f3fb', '8d7f7434-5cd4-405d-92f3-283d219286ed', '26cce400-8691-423d-9980-4a51321049ed'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:28 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:24:28 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:28 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.315s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:28 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:24:28 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] Deleted volume successfully. Sep 28 16:24:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-73c393c5-86b7-461f-bf89-fa1812ecc404 tempest-ProjectMemberTests-462857659 None] Lock "cinder-7575076c-db1e-4544-a535-942be06237c4-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Flow 'volume_create_manager' (b88c2653-ab62-44f2-b479-3ff09d8faf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76eacf1b-43eb-4341-9e1c-d90b0360ea2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76eacf1b-43eb-4341-9e1c-d90b0360ea2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-583432380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21ad079-57fa-481d-87a2-a8c260f350c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7450133953dc42bc96e4113d16a5eb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:29Z,use_quota=True,user_id='ffc597531cc541ce8ddc9f6ac2ca8be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b250179-c559-48a3-9f65-e1d091edd4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b250179-c559-48a3-9f65-e1d091edd4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbe6f4f-0b58-4c44-bf4e-8d5dc74f210e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbe6f4f-0b58-4c44-bf4e-8d5dc74f210e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd21ad079-57fa-481d-87a2-a8c260f350c4', 'volume_name': 'volume-d21ad079-57fa-481d-87a2-a8c260f350c4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0500d40-7228-47a9-85a3-d7df18379fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0500d40-7228-47a9-85a3-d7df18379fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9464625-d9f5-42d8-af80-aeaa8ab49990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:29 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Volume d21ad079-57fa-481d-87a2-a8c260f350c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d21ad079-57fa-481d-87a2-a8c260f350c4', 'volume_size': 1} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-583432380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21ad079-57fa-481d-87a2-a8c260f350c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7450133953dc42bc96e4113d16a5eb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:29Z,use_quota=True,user_id='ffc597531cc541ce8ddc9f6ac2ca8be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Creating volume d21ad079-57fa-481d-87a2-a8c260f350c4 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:24:29 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:29 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4 1073741824 Sep 28 16:24:29 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:29 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4 1073741824" returned: 0 in 0.470s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:29 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4 Sep 28 16:24:29 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:30 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4" returned: 0 in 0.283s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:24:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9464625-d9f5-42d8-af80-aeaa8ab49990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d21ad079-57fa-481d-87a2-a8c260f350c4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad307f8-9e78-483c-b113-123e43fe0f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:30 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Volume volume-d21ad079-57fa-481d-87a2-a8c260f350c4 (d21ad079-57fa-481d-87a2-a8c260f350c4): created successfully Sep 28 16:24:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad307f8-9e78-483c-b113-123e43fe0f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Flow 'volume_create_manager' (b88c2653-ab62-44f2-b479-3ff09d8faf17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c4950043-e9f2-4399-be6b-c2b797d4b682 tempest-ProjectMemberTests-462857659 None] Created volume successfully. Sep 28 16:24:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3c5f90c0-c7f0-4694-8e5a-38969bdd9ef6 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3c5f90c0-c7f0-4694-8e5a-38969bdd9ef6 tempest-ProjectMemberTests-462857659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3c5f90c0-c7f0-4694-8e5a-38969bdd9ef6 tempest-ProjectMemberTests-462857659 None] Creating offline snapshot 6f3a29e7-890c-4236-9d69-3362d89d4227 of volume d21ad079-57fa-481d-87a2-a8c260f350c4 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:24:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a42155a-6e1d-4475-99c5-77bcbf529077]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c5f90c0-c7f0-4694-8e5a-38969bdd9ef6 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:31 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4 Sep 28 16:24:31 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:31 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c5f90c0-c7f0-4694-8e5a-38969bdd9ef6 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4" returned: 0 in 0.404s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c5f90c0-c7f0-4694-8e5a-38969bdd9ef6 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:31 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227 1G Sep 28 16:24:31 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:32 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c5f90c0-c7f0-4694-8e5a-38969bdd9ef6 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227 1G" returned: 0 in 0.429s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c5f90c0-c7f0-4694-8e5a-38969bdd9ef6 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d21ad079-57fa-481d-87a2-a8c260f350c4 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:32 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d21ad079-57fa-481d-87a2-a8c260f350c4 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227 Sep 28 16:24:32 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:32 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c5f90c0-c7f0-4694-8e5a-38969bdd9ef6 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d21ad079-57fa-481d-87a2-a8c260f350c4 -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227" returned: 0 in 0.317s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:32 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-3c5f90c0-c7f0-4694-8e5a-38969bdd9ef6 tempest-ProjectMemberTests-462857659 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227 is being set with open permissions: ugo+rw Sep 28 16:24:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c5f90c0-c7f0-4694-8e5a-38969bdd9ef6 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:32 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227 Sep 28 16:24:32 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:32 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c5f90c0-c7f0-4694-8e5a-38969bdd9ef6 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227" returned: 0 in 0.280s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c5f90c0-c7f0-4694-8e5a-38969bdd9ef6 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:33 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.info Sep 28 16:24:33 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:33 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c5f90c0-c7f0-4694-8e5a-38969bdd9ef6 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.info" returned: 0 in 0.286s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:33 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-3c5f90c0-c7f0-4694-8e5a-38969bdd9ef6 tempest-ProjectMemberTests-462857659 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.info is being set with open permissions: ugo+rw Sep 28 16:24:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c5f90c0-c7f0-4694-8e5a-38969bdd9ef6 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:33 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.info Sep 28 16:24:33 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:33 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c5f90c0-c7f0-4694-8e5a-38969bdd9ef6 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.info" returned: 0 in 0.250s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3c5f90c0-c7f0-4694-8e5a-38969bdd9ef6 tempest-ProjectMemberTests-462857659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.061s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3c5f90c0-c7f0-4694-8e5a-38969bdd9ef6 tempest-ProjectMemberTests-462857659 None] Create snapshot completed successfully Sep 28 16:24:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-6f3a29e7-890c-4236-9d69-3362d89d4227-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] Lock "cinder-6f3a29e7-890c-4236-9d69-3362d89d4227-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-d21ad079-57fa-481d-87a2-a8c260f350c4" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-d21ad079-57fa-481d-87a2-a8c260f350c4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-6f3a29e7-890c-4236-9d69-3362d89d4227" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-6f3a29e7-890c-4236-9d69-3362d89d4227" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] Deleting offline snapshot 6f3a29e7-890c-4236-9d69-3362d89d4227 of volume d21ad079-57fa-481d-87a2-a8c260f350c4 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:24:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] snapshot_file for this snap is: volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:24:34 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fca9fce-137b-44e3-8b2a-4e9c88c1e86a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:24:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:24:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:24:35 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227 Sep 28 16:24:35 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:35 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227" returned: 0 in 0.411s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d21ad079-57fa-481d-87a2-a8c260f350c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:24:35 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35ab75d-bc3c-4676-ab94-416e70e83690]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:35 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4 Sep 28 16:24:35 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:35 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4" returned: 0 in 0.396s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:35 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227 Sep 28 16:24:35 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:36 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227" returned: 0 in 0.394s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:36 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227 Sep 28 16:24:36 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:36 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4.6f3a29e7-890c-4236-9d69-3362d89d4227" returned: 0 in 0.266s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-6f3a29e7-890c-4236-9d69-3362d89d4227" released by "_delete_snapshot" :: held 1.576s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-d21ad079-57fa-481d-87a2-a8c260f350c4" released by "delete_snapshot" :: held 1.603s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:36 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] Created reservations ['f2f65958-2dea-4607-a8eb-e3723db07020', '11697660-3c70-40f4-ac55-811ff83524ed', '8f8119c9-dc8a-4778-9216-daada4c52639', '0d86ccfb-6ad4-44ae-bdf3-14149637ce04'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] Delete snapshot completed successfully. Sep 28 16:24:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5fdb1923-ab80-4a88-9451-2478e7a11f21 tempest-ProjectMemberTests-462857659 None] Lock "cinder-6f3a29e7-890c-4236-9d69-3362d89d4227-delete_snapshot" released by "delete_snapshot" :: held 1.786s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-d21ad079-57fa-481d-87a2-a8c260f350c4-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] Lock "cinder-d21ad079-57fa-481d-87a2-a8c260f350c4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] Acquiring lock "cinder-quobyte-d21ad079-57fa-481d-87a2-a8c260f350c4" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-d21ad079-57fa-481d-87a2-a8c260f350c4" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a7d510-1a29-4f0e-9812-7c123ac2fb8a]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:37 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4 Sep 28 16:24:37 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:37 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4" returned: 0 in 0.386s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:37 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4 Sep 28 16:24:37 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:37 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-d21ad079-57fa-481d-87a2-a8c260f350c4" returned: 0 in 0.275s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] Lock "cinder-quobyte-d21ad079-57fa-481d-87a2-a8c260f350c4" released by "delete_volume" :: held 0.732s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:37 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] Created reservations ['714224d2-1ed1-48ea-b8dc-a47dcf5cf3db', 'a67aadd2-f00e-4a02-b482-fc63f0280d3e', 'c9af57ec-b2ad-4ef9-b27b-c14d6307442a', '9b4fa92d-3ce1-4e1c-9915-752e4d866556'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:37 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:24:37 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:38 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.276s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:38 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:24:38 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] Deleted volume successfully. Sep 28 16:24:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3e18e18b-e6f2-408f-b2e7-0a8f149f7512 tempest-ProjectMemberTests-462857659 None] Lock "cinder-d21ad079-57fa-481d-87a2-a8c260f350c4-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:47 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:INSERT=13,cinder:UPDATE=43,cinder:SELECT=27,cinder:DELETE=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:24:48 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=35,cinder:INSERT=11,cinder:UPDATE=44,cinder:DELETE=5 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Flow 'volume_create_manager' (eaef0768-efe0-4f2d-91a7-baa91533a5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bcf8cfc-f900-46a4-88d3-6cf3c4069b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bcf8cfc-f900-46a4-88d3-6cf3c4069b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1472675654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564f8a13-8cfe-45e8-b186-48355354db4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c15876b00e9494cb2d731299a8120b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:25:20Z,use_quota=True,user_id='eb51e49420544a6ea4eab63f8c1f2ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4a3d08-e359-4d79-addd-a0760cd3596c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4a3d08-e359-4d79-addd-a0760cd3596c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8af5078-a4cd-4464-98c1-49ff2a242cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8af5078-a4cd-4464-98c1-49ff2a242cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '564f8a13-8cfe-45e8-b186-48355354db4e', 'volume_name': 'volume-564f8a13-8cfe-45e8-b186-48355354db4e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde6af6f-446f-4bdb-bc74-61b4bd298439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde6af6f-446f-4bdb-bc74-61b4bd298439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90920d4-0080-4706-b6cb-4ccf5a02766b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:19 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Volume 564f8a13-8cfe-45e8-b186-48355354db4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-564f8a13-8cfe-45e8-b186-48355354db4e', 'volume_size': 1} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1472675654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564f8a13-8cfe-45e8-b186-48355354db4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c15876b00e9494cb2d731299a8120b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:25:20Z,use_quota=True,user_id='eb51e49420544a6ea4eab63f8c1f2ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Creating volume 564f8a13-8cfe-45e8-b186-48355354db4e {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:25:19 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] casted to osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f Sep 28 16:25:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:19 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e 1073741824 Sep 28 16:25:19 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:20 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e 1073741824" returned: 0 in 0.462s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:20 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e Sep 28 16:25:20 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:20 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e" returned: 0 in 0.241s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:25:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90920d4-0080-4706-b6cb-4ccf5a02766b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-564f8a13-8cfe-45e8-b186-48355354db4e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b148ad0-b236-40c5-b61e-c5423e51a18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:20 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Volume volume-564f8a13-8cfe-45e8-b186-48355354db4e (564f8a13-8cfe-45e8-b186-48355354db4e): created successfully Sep 28 16:25:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b148ad0-b236-40c5-b61e-c5423e51a18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Flow 'volume_create_manager' (eaef0768-efe0-4f2d-91a7-baa91533a5f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:25:20 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c68e1298-6904-4e2e-9f0b-6b00e2bbc471 tempest-SnapshotDependencyTests-751244866 None] Created volume successfully. Sep 28 16:25:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dd626f9d-1863-4f73-b0ef-f91ab157c1e5 tempest-SnapshotDependencyTests-751244866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dd626f9d-1863-4f73-b0ef-f91ab157c1e5 tempest-SnapshotDependencyTests-751244866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-dd626f9d-1863-4f73-b0ef-f91ab157c1e5 tempest-SnapshotDependencyTests-751244866 None] Creating offline snapshot 70580223-c756-408c-a0e2-392085385e4b of volume 564f8a13-8cfe-45e8-b186-48355354db4e {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:25:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[533864ca-d58d-4187-87a1-991813b45e92]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:25:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd626f9d-1863-4f73-b0ef-f91ab157c1e5 tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:21 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e Sep 28 16:25:21 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:21 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd626f9d-1863-4f73-b0ef-f91ab157c1e5 tempest-SnapshotDependencyTests-751244866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e" returned: 0 in 0.372s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd626f9d-1863-4f73-b0ef-f91ab157c1e5 tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:21 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b 1G Sep 28 16:25:21 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:21 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd626f9d-1863-4f73-b0ef-f91ab157c1e5 tempest-SnapshotDependencyTests-751244866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b 1G" returned: 0 in 0.426s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd626f9d-1863-4f73-b0ef-f91ab157c1e5 tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-564f8a13-8cfe-45e8-b186-48355354db4e -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:21 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-564f8a13-8cfe-45e8-b186-48355354db4e -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b Sep 28 16:25:21 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:22 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd626f9d-1863-4f73-b0ef-f91ab157c1e5 tempest-SnapshotDependencyTests-751244866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-564f8a13-8cfe-45e8-b186-48355354db4e -F qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b" returned: 0 in 0.279s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:22 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-dd626f9d-1863-4f73-b0ef-f91ab157c1e5 tempest-SnapshotDependencyTests-751244866 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b is being set with open permissions: ugo+rw Sep 28 16:25:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd626f9d-1863-4f73-b0ef-f91ab157c1e5 tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:22 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b Sep 28 16:25:22 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:22 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd626f9d-1863-4f73-b0ef-f91ab157c1e5 tempest-SnapshotDependencyTests-751244866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b" returned: 0 in 0.250s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd626f9d-1863-4f73-b0ef-f91ab157c1e5 tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:22 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.info Sep 28 16:25:22 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:22 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd626f9d-1863-4f73-b0ef-f91ab157c1e5 tempest-SnapshotDependencyTests-751244866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.info" returned: 0 in 0.250s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:22 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-dd626f9d-1863-4f73-b0ef-f91ab157c1e5 tempest-SnapshotDependencyTests-751244866 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.info is being set with open permissions: ugo+rw Sep 28 16:25:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd626f9d-1863-4f73-b0ef-f91ab157c1e5 tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:22 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.info Sep 28 16:25:22 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:22 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd626f9d-1863-4f73-b0ef-f91ab157c1e5 tempest-SnapshotDependencyTests-751244866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.info" returned: 0 in 0.243s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dd626f9d-1863-4f73-b0ef-f91ab157c1e5 tempest-SnapshotDependencyTests-751244866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.911s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:22 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-dd626f9d-1863-4f73-b0ef-f91ab157c1e5 tempest-SnapshotDependencyTests-751244866 None] Create snapshot completed successfully Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Flow 'volume_create_manager' (f0426b8e-793f-435c-817d-12fa9816e20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d595221-acdc-44b9-86f5-6e412bd36ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d595221-acdc-44b9-86f5-6e412bd36ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e80bbb-7249-4297-8662-1283d29f8127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c15876b00e9494cb2d731299a8120b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=70580223-c756-408c-a0e2-392085385e4b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:25:24Z,use_quota=True,user_id='eb51e49420544a6ea4eab63f8c1f2ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50daf778-ae96-4678-aa7a-d601af73155c),volume_type_id=50daf778-ae96-4678-aa7a-d601af73155c)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba0ace9-946e-4f25-aae6-72c917d38fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba0ace9-946e-4f25-aae6-72c917d38fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156be21c-8a29-4058-a1a8-621ec8975b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156be21c-8a29-4058-a1a8-621ec8975b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '36e80bbb-7249-4297-8662-1283d29f8127', 'volume_name': 'volume-36e80bbb-7249-4297-8662-1283d29f8127', 'volume_size': 1, 'snapshot_id': '70580223-c756-408c-a0e2-392085385e4b'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16016d66-952c-4cf9-8cef-9c09b02a3cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16016d66-952c-4cf9-8cef-9c09b02a3cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fecb26c-869a-4fda-a5a8-b484c3c12b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:23 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Volume 36e80bbb-7249-4297-8662-1283d29f8127: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-36e80bbb-7249-4297-8662-1283d29f8127', 'volume_size': 1, 'snapshot_id': '70580223-c756-408c-a0e2-392085385e4b'} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Acquiring lock "cinder-quobyte-70580223-c756-408c-a0e2-392085385e4b-36e80bbb-7249-4297-8662-1283d29f8127" by "_create_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Lock "cinder-quobyte-70580223-c756-408c-a0e2-392085385e4b-36e80bbb-7249-4297-8662-1283d29f8127" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Creating volume 36e80bbb-7249-4297-8662-1283d29f8127 from snapshot 70580223-c756-408c-a0e2-392085385e4b {{(pid=87087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Selected osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Acquiring lock "cinder-quobyte-36e80bbb-7249-4297-8662-1283d29f8127" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Lock "cinder-quobyte-36e80bbb-7249-4297-8662-1283d29f8127" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] snapshot: 70580223-c756-408c-a0e2-392085385e4b, volume: 36e80bbb-7249-4297-8662-1283d29f8127, {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8aa8d9-2bb2-4705-9b55-1d9f9a683444]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:25:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:24 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b Sep 28 16:25:24 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:24 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b" returned: 0 in 0.380s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-564f8a13-8cfe-45e8-b186-48355354db4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:25:24 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cffd55-9c33-474f-bbea-83a54e9c6efe]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:25:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:24 devstack sudo[108775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e Sep 28 16:25:24 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:24 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e" returned: 0 in 0.381s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:25:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:25:24 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Path /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-36e80bbb-7249-4297-8662-1283d29f8127 not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:25:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-36e80bbb-7249-4297-8662-1283d29f8127 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:24 devstack sudo[108780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-36e80bbb-7249-4297-8662-1283d29f8127 Sep 28 16:25:24 devstack sudo[108780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:30 devstack sudo[108780]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-36e80bbb-7249-4297-8662-1283d29f8127" returned: 0 in 5.897s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:30 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-36e80bbb-7249-4297-8662-1283d29f8127 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:25:30 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Converted 1024.00 MB image at 173.61 MB/s Sep 28 16:25:30 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-36e80bbb-7249-4297-8662-1283d29f8127 is being set with open permissions: ugo+rw Sep 28 16:25:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-36e80bbb-7249-4297-8662-1283d29f8127 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:30 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-36e80bbb-7249-4297-8662-1283d29f8127 Sep 28 16:25:30 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:30 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-36e80bbb-7249-4297-8662-1283d29f8127" returned: 0 in 0.251s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Lock "cinder-quobyte-36e80bbb-7249-4297-8662-1283d29f8127" released by "_copy_volume_from_snapshot" :: held 6.991s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Lock "cinder-quobyte-70580223-c756-408c-a0e2-392085385e4b-36e80bbb-7249-4297-8662-1283d29f8127" released by "_create_volume_from_snapshot" :: held 7.052s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.070s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fecb26c-869a-4fda-a5a8-b484c3c12b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36e80bbb-7249-4297-8662-1283d29f8127', 'volume_size': 1, 'snapshot_id': '70580223-c756-408c-a0e2-392085385e4b'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8824dc23-ef44-4ecf-ab9d-ad7cbc5dd0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:30 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Volume volume-36e80bbb-7249-4297-8662-1283d29f8127 (36e80bbb-7249-4297-8662-1283d29f8127): created successfully Sep 28 16:25:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8824dc23-ef44-4ecf-ab9d-ad7cbc5dd0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Flow 'volume_create_manager' (f0426b8e-793f-435c-817d-12fa9816e20e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:25:31 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-44c937eb-beea-410b-91af-1ffbe730662a tempest-SnapshotDependencyTests-751244866 None] Created volume successfully. Sep 28 16:25:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] Acquiring lock "cinder-70580223-c756-408c-a0e2-392085385e4b-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:25:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] Lock "cinder-70580223-c756-408c-a0e2-392085385e4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:25:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] Acquiring lock "cinder-quobyte-564f8a13-8cfe-45e8-b186-48355354db4e" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:25:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] Lock "cinder-quobyte-564f8a13-8cfe-45e8-b186-48355354db4e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:25:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] Acquiring lock "cinder-quobyte-70580223-c756-408c-a0e2-392085385e4b" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:25:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] Lock "cinder-quobyte-70580223-c756-408c-a0e2-392085385e4b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:25:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] Deleting offline snapshot 70580223-c756-408c-a0e2-392085385e4b of volume 564f8a13-8cfe-45e8-b186-48355354db4e {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:25:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] snapshot_file for this snap is: volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:25:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47f1575-66a5-416c-ae06-991c10bbf1eb]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:25:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:31 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b Sep 28 16:25:31 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:31 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b" returned: 0 in 0.385s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-564f8a13-8cfe-45e8-b186-48355354db4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:25:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e60830-ec29-40d7-88d5-99b3c62fb200]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:25:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:32 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e Sep 28 16:25:32 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:32 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e" returned: 0 in 0.569s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:32 devstack sudo[108844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b Sep 28 16:25:32 devstack sudo[108844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:32 devstack sudo[108844]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b" returned: 0 in 0.345s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:32 devstack sudo[108850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b Sep 28 16:25:32 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:33 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e.70580223-c756-408c-a0e2-392085385e4b" returned: 0 in 0.251s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] Lock "cinder-quobyte-70580223-c756-408c-a0e2-392085385e4b" released by "_delete_snapshot" :: held 1.659s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] Lock "cinder-quobyte-564f8a13-8cfe-45e8-b186-48355354db4e" released by "delete_snapshot" :: held 1.681s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:33 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] Created reservations ['48ba26b0-30d9-41d6-93bc-dd20265394b8', '4341f20e-d25f-482d-bf2c-ef242c3f0b7f', 'a09e57bc-786b-4286-a6a0-f4ebd3d742ee', '1e7517c6-8d85-4191-987f-a895f6d72139'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:25:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] Delete snapshot completed successfully. Sep 28 16:25:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-06f393ba-0c80-4a5a-85fb-b4b0c7130979 tempest-SnapshotDependencyTests-751244866 None] Lock "cinder-70580223-c756-408c-a0e2-392085385e4b-delete_snapshot" released by "delete_snapshot" :: held 1.822s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] Acquiring lock "cinder-564f8a13-8cfe-45e8-b186-48355354db4e-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:25:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] Lock "cinder-564f8a13-8cfe-45e8-b186-48355354db4e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:25:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] Acquiring lock "cinder-quobyte-564f8a13-8cfe-45e8-b186-48355354db4e" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:25:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] Lock "cinder-quobyte-564f8a13-8cfe-45e8-b186-48355354db4e" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:25:33 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f4bd9b-e42d-4414-9657-167928f1afb1]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:25:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:33 devstack sudo[108853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e Sep 28 16:25:33 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:34 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e" returned: 0 in 0.370s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:34 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e Sep 28 16:25:34 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:34 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-564f8a13-8cfe-45e8-b186-48355354db4e" returned: 0 in 0.255s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] Lock "cinder-quobyte-564f8a13-8cfe-45e8-b186-48355354db4e" released by "delete_volume" :: held 0.689s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] Created reservations ['e52e418f-5fbc-4ad1-8eeb-2e3453f7096f', '73ff41c7-d134-4b12-beda-b90aa0f81998', '82a7a8fd-b405-4d31-84c3-9950be0ddb6e', '466b7140-52e9-4694-8b79-e6a0840e0817'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:34 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:25:34 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:34 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.264s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:25:34 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] Deleted volume successfully. Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] Acquiring lock "cinder-36e80bbb-7249-4297-8662-1283d29f8127-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ca3dffb0-061a-449a-a088-cf9d178ccdd6 tempest-SnapshotDependencyTests-751244866 None] Lock "cinder-564f8a13-8cfe-45e8-b186-48355354db4e-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] Lock "cinder-36e80bbb-7249-4297-8662-1283d29f8127-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] Acquiring lock "cinder-quobyte-36e80bbb-7249-4297-8662-1283d29f8127" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] Lock "cinder-quobyte-36e80bbb-7249-4297-8662-1283d29f8127" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a46e6b-ffd8-4886-af2d-55baa5f5045e]: (4, 'qcow2') {{(pid=88124) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:25:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-36e80bbb-7249-4297-8662-1283d29f8127 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:35 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-36e80bbb-7249-4297-8662-1283d29f8127 Sep 28 16:25:35 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:35 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:25:35 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:35 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.252s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread count: 29 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcb3c169-8058-4f49-8f2e-48b80a28a28f None None] thread info: [<_MainThread(MainThread, started 135946376503424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:25:35 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-36e80bbb-7249-4297-8662-1283d29f8127" returned: 0 in 0.414s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-36e80bbb-7249-4297-8662-1283d29f8127 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:35 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-36e80bbb-7249-4297-8662-1283d29f8127 Sep 28 16:25:35 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:35 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638/volume-36e80bbb-7249-4297-8662-1283d29f8127" returned: 0 in 0.232s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] Lock "cinder-quobyte-36e80bbb-7249-4297-8662-1283d29f8127" released by "delete_volume" :: held 0.689s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] Created reservations ['e85b2395-3940-402a-8081-47a20c70b989', '7b1d4b45-d62f-4ddc-acc4-c8e6564d3c41', '5d9570c0-91e1-45a0-9a19-78923aa6c109', 'b5967d57-4b36-44bd-88d8-61f74df27b76'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b161f209-3f9c-481f-8346-855297bb832f'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:35 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638 Sep 28 16:25:35 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:35 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc13e4a76ad60c22141d4b745b41c638" returned: 0 in 0.276s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:25:35 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] Deleted volume successfully. Sep 28 16:25:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cc2068e0-2aea-4d22-a657-c4e52dd41d38 tempest-SnapshotDependencyTests-751244866 None] Lock "cinder-36e80bbb-7249-4297-8662-1283d29f8127-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:45 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=27,cinder:SELECT=24,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:25:46 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=25,cinder:UPDATE=31,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}